Файловый менеджер - Редактировать - /home/digitalm/venv/lib/python3.7/site-packages/pandas/tests/io/__pycache__/test_stata.cpython-37.pyc
Назад
B �5�g�7 � @ s d dl Z d dlZd dlmZ d dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl Z d dl Z d dl mZ d dlZd dlmZ d dlmZmZ d dlmZ d dlmZmZm Z m Z m Z m Z m Z m!Z! e �"� dd� �Z#e j"d d � �Z$e j"d d � �Z%G d d� d�Z&e j'�(ddddddg�dd� �Z)e j'�(ddddddg�e j'�(ddd g�e j'�(d dd g�d d � ���Z*e j'�(d d!d g�e j'�(d"dd#d!g�d$d%� ��Z+e j'�(ddddddg�d&d'� �Z,d(d)� Z-d*d+� Z.d,d-� Z/d.d/� Z0d0d1� Z1e j'�(d2dd g�e j'�(d3dd g�d4d5� ��Z2dS )6� N)�datetime)�is_categorical_dtype)� DataFrame�Series)�read_csv)� CategoricalConversionWarning�InvalidColumnName�PossiblePrecisionLoss�StataMissingValue� StataReader�StataWriterUTF8�ValueLabelTypeMismatch� read_statac C s( t ddddgddddgd d d d gd ��S )N� � � � g �?g @g ;@g @T@ZAtlantaZ BirminghamZ CincinnatiZDetroit)�a�b�c)r � r r �P/home/digitalm-up/venv/lib/python3.7/site-packages/pandas/tests/io/test_stata.py� mixed_frame% s r c C s | ddd�S )N�io�data�statar )�datapathr r r �dirpath0 s r c C s& t j�| d�}t|dd�}d|j_|S )Nzstata5_114.dtaT)� convert_dates�index)�os�path�joinr r �name)r � dta14_114� parsed_114r r r r% 5 s r% c @ s e Zd Zejdd�dd� �Zdd� Zdd� Zej� d d d d d dg�dd� �Z ej� dddg�dd� �Z dd� Z ej� dddddg�d d � �Z ej� dd d d d!g�d"d#� �Zd$d%� Zd&d'� Zd(d)� Zd*d+� Zej� d d d d d dg�d,d-� �Zd.d/� Zd0d1� Zej� d d d d d dg�d2d3� �Zd4d5� Zej� d d d d d dg�d6d7� �Zd8d9� Zej� d d d d d dg�ej� dd:d;d<d=g�d>d?� ��Zej� dd@dAdBdCg�dDdE� �Zej� d d d d d dg�dFdG� �Z ej� d d d d d dg�dHdI� �Z dJdK� Z ej� d d d d d dg�dLdM� �Z dNdO� Z dPdQ� Z!dRdS� Z"dTdU� Z#dVdW� Z$dXdY� Z%dZd[� Z&d\d]� Z'ej� d d d d d dg�ej� d^d_d`g�dadb� ��Z(dcdd� Z)dedf� Z*dgdh� Z+didj� Z,ej� ddkdldmg�dndo� �Z-dpdq� Z.drds� Z/dtdu� Z0ej� d d d d d dg�ej�1dv�dwdx� ��Z2dydz� Z3ej� d d d d d dg�d{d|� �Z4ej� dd}d~g�dd�� �Z5ej� dd�d�g�d�d�� �Z6ej� dd}d~g�d�d�� �Z7ej� ddd�dd!d=dCd�dmd�d~d�g �ej� d�d�d�g�ej� d�d�dg�ej� d�d�dg�d�d�� ����Z8e9e:e:d��d�d���Z;d�d�� Z<ej� dd�dd d<dBd�dld�d}d�g �ej� d�d�d�g�ej� d�d�dg�ej� d�d�dg�d�d�� ����Z=d�d�� Z>ej� d d d d d dg�d�d�� �Z?ej� d d d d d dg�d�d�� �Z@ej� d d d g�d�d�� �ZAd�d�� ZBd�d�� ZCd�d�� ZDd�d�� ZEd�d�� ZFd�d�� ZGd�d�� ZHd�d�� ZId�d�� ZJd�d�� ZKej� d�dd�g�d�d�� �ZLd�d�� ZMej� d�d�d�d�d�d�d�d�g�d�dƄ �ZNd�dȄ ZOd�dʄ ZPd�d̄ ZQej� d d d d d dg�d�d΄ �ZRd�dЄ ZSd�d҄ ZTd�dԄ ZUej� d d d d d dg�d�dք �ZVej� d d d d d dg�d�d �ZWd�dڄ ZXd�d܄ ZYejjZd�dބ �Z[ej� d d d dg�d�d� �Z\d�d� Z]dS )�� TestStataT)Zautousec C s< |ddd�| _ tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d �| _ tj�| j d �| _ tj�| j d �| _ tj�| j d �| _ tj�| j d �| _ tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d�| _tj�| j d �| _ tj�| j d �| _ tj�| j d �| _ tj�| j d �| _ tj�| j d �| _ tj�| j d!�| _!tj�| j d"�| _"tj�| j d#�| _#tj�| j d$�| _$tj�| j d%�| _%tj�| j d&�| _&tj�| j d'�| _'tj�| j d(�| _(tj�| j d)�| _)tj�| j d*�| _*tj�| j d+�| _+tj�| j d,�| _,tj�| j d-�| _-tj�| j d.�| _.tj�| j d/�| _/tj�| j d0�| _0d S )1Nr r r zstata1_114.dtazstata1_117.dtazstata2_113.dtazstata2_114.dtazstata2_115.dtazstata2_117.dtazstata3_113.dtazstata3_114.dtazstata3_115.dtazstata3_117.dtaz stata3.csvzstata4_113.dtazstata4_114.dtazstata4_115.dtazstata4_117.dtazstata1_encoding.dtazstata1_encoding_118.dtaz stata5.csvzstata5_113.dtazstata5_114.dtazstata5_115.dtazstata5_117.dtaz stata6.csvzstata6_113.dtazstata6_114.dtazstata6_115.dtazstata6_117.dtazstata7_115.dtazstata7_117.dtazstata8_113.dtazstata8_115.dtazstata8_117.dtazstata9_115.dtazstata9_117.dtazstata10_115.dtazstata10_117.dtazstata11_115.dtazstata11_117.dtazstata12_117.dtazstata14_118.dtaz stata15.dtazstata7_111.dtazstata16_118.dtazstata1_119.dta.gzzstata13_dates.dta)1r r r! r" �dta1_114�dta1_117Zdta2_113�dta2_114�dta2_115�dta2_117�dta3_113�dta3_114�dta3_115�dta3_117�csv3�dta4_113�dta4_114�dta4_115�dta4_117� dta_encoding�dta_encoding_118�csv14� dta14_113r$ � dta14_115� dta14_117�csv15� dta15_113� dta15_114� dta15_115� dta15_117� dta16_115� dta16_117� dta17_113� dta17_115� dta17_117� dta18_115� dta18_117� dta19_115� dta19_117� dta20_115� dta20_117� dta21_117� dta22_118�dta23� dta24_111� dta25_118� dta26_119� stata_dates)�selfr r r r � setup_method> s\ zTestStata.setup_methodc C s t |dd�S )NT)r )r )rR �filer r r �read_dta s zTestStata.read_dtac C s t |dd�S )NT)Z parse_dates)r )rR rT r r r r � s zTestStata.read_csv�version�r �u �v �w Nc C sH t dgd�}t�� �*}|j|d|d� t|�}t�||� W d Q R X d S )N�unit)�columnsF)� write_indexrV )r �tm� ensure_clean�to_statar �assert_frame_equal)rR rV Zempty_dsr! Z empty_ds2r r r �test_read_empty_dta� s z TestStata.test_read_empty_dtarT r' r( c C sd t | |�}| �|�}ttjtjtjtjtjfgdddddgd�}|d �tj�|d< t�||� d S )N� float_miss� double_miss� byte_miss�int_miss� long_miss)r\ ) �getattrrU r �np�nan�astype�float32r^ ra )rR rT �parsed�expectedr r r �test_read_dta1� s zTestStata.test_read_dta1c C s� t jtdddddd�dtdd d�tdd d �tdd d �td d d �tdd d �tdd d �ftd ddddd�dtddd�tddd�tdd d �tdd d �tdd d �tdd d �ftjtjtjtjtjtjtjtjfgddddd d d d gd �}|d �d!�|d < tjd"d#��T}t�d$� | � | j �}| � | j �}| � | j �}d%d&� |D �}t |�dk�sNt�W d Q R X tj||d"d'� tj||d"d'� tj||d"d'� d S )(Ni� � � � � � l *�}ai� r � i� � i� � � r iZl�i� � r i� � i� Z datetime_cZdatetime_big_c�dateZ weekly_dateZ monthly_dateZquarterly_dateZhalf_yearly_dateZ yearly_date)r\ �OT)�record�alwaysc S s g | ]}|j tkr|�qS r )�category� UserWarning)�.0�xr r r � <listcomp>� s z,TestStata.test_read_dta2.<locals>.<listcomp>)�check_datetimelike_compat)r � from_recordsr �pd�NaTrk �warnings�catch_warnings� simplefilterrU r) r* r+ �len�AssertionErrorr^ ra )rR rn �wr% � parsed_115� parsed_117r r r �test_read_dta2� sJ $ zTestStata.test_read_dta2r, r- r. r/ c C sd t | |�}| �|�}| �| j�}|�tj�}|d �tj�|d< |d �tj�|d< t � ||� d S )N�year�quarter) rh rU r r0 rk ri rl �int16�int8r^ ra )rR rT rm rn r r r �test_read_dta3� s zTestStata.test_read_dta3r1 r2 r3 r4 c C s. t | |�}| �|�}tjdddddgdddddgdddddgddd ddgd d d tjd gd d d tjd gdddtjdgdddtjdgdddtjdgdddtjdgg dddddgd�}xl|D ]d}|| �� }t�|d |�� �}|dkr�|}|� d�j }|j |dd�}|j j d dd� |||< q�W t�||� d S )N�one�ten�two�nine�three�eight�four�sevenr �five�six� rz rv ru � � fully_labeled�fully_labeled2�incompletely_labeled�labeled_with_missings�float_labelled)r\ r T)�ordered)�inplace)rh rU r r� ri rj �copyZasarrayZnotnark �_values�set_categories� categories�renamer^ ra )rR rT rm rn �col�origr� �catr r r �test_read_dta4� s8 zTestStata.test_read_dta4c C sL | � | j�}tjdddgdddgddd ggd d d gd �}tj||dd� d S )Nr �abcZ abcdefghir ZcbaZqwertywertyqwerty�] � Zstrlr� �y�z)r\ F)� check_dtype)rU rK r r� r^ ra )rR r� rn r r r �test_read_dta12 s zTestStata.test_read_dta12c C s | � | j�}|d �d�|d< tjdddddddgd d d tjtjtjtjgd d dddddgdddddddgdddddddggdd d d d dd gd!�}|d �tj�|d < x"|jD ]}t � || || � q�W t | j��>}|� � }d"d#d$d%d&d'd(d)�}t � ||� |jd*k�st�W d Q R X d S )+N�Bytesr| ZCatZBogotau Bogotár g �?u option b ÜnicodeZDogZBostonu UzunköprüZPlaneZRomeu Tromsør g zoption aZPotatoZTokyou Elâzığ���g @r r� g����T�?gUUUUUU�?�Things�Cities�Unicode_Cities_Strl�Ints�Floats�Longs)r\ u' Here are some strls with Ünicode charsz long datazHere are some thingsz byte datazint datazHere are some citiesz float data)r� r� r� r� r� r� r� u This is a Ünicode data label)rU rL rk r r� ri rj rl r\ r^ Zassert_almost_equalr �variable_labelsZassert_dict_equal� data_labelr� )rR Z parsed_118rn r� �rdrZvlZ vl_expectedr r r �test_read_dta18' s: zTestStata.test_read_dta18c C st t tjtjtjtjtjfgdddddgd�}d|j_t�� �.}|�|d � | �|�}t� |� d�|� W d Q R X d S )Nrc rd re rf rg )r\ r ) r ri rj r r# r^ r_ r` rU ra � set_index)rR �originalr! �written_and_read_againr r r �test_read_write_dta5O s z TestStata.test_read_write_dta5c C s� | � | j�}d|j_|j�tj�|_|d �tj�|d< |d �tj�|d< t�� �2}|� |d � | � |�}tj |� d�|dd� W d Q R X d S )Nr r� r� F)�check_index_type) r r0 r r# rk ri �int32r^ r_ r` rU ra r� )rR r� r! r� r r r �test_write_dta6[ s zTestStata.test_write_dta6c C s� t ddddt�d�ggdddddgd �}t|d td �|d< d |j_|j�tj�|_|d �tj�|d< t � � �:}|j |dd i|d � | � |�}t j |�d �|dd� W d Q R X d S )N�string�objectr g�������?z 2003-12-25�integer�floatingr )r r\ )�dtyper �tc)rV F)r� )r ri � datetime64r r� r r# rk r� r^ r_ r` rU ra r� )rR rV r� r! r� r r r �test_read_write_dta10k s z TestStata.test_read_write_dta10c C s< t �� �*}ttj�dd�td�d�}|�|� W d Q R X d S )Nry r �AB)r\ )r^ r_ r ri �random�randn�listr` )rR r! �dfr r r �test_stata_doc_examples� s z!TestStata.test_stata_doc_examplesc C st t j�d� tt j�dd�td�d�}t j|jddd�f< |�� }t � � �}|j |d d � W d Q R X t � ||� d S ) Ni� r� r �abcd)r\ r r r F)r] ) ri r� �seedr r� r� rj �locr� r^ r_ r` ra )rR r� Zdf_copyr! r r r � test_write_preserves_original� s z'TestStata.test_write_preserves_originalc C s~ t | j�}t | j�}|jd }|jd }||ks4t�t|t�sBt�t�� �*}|j|d|d� t |�}t� ||� W d Q R X d S )Nr F)r] rV ) r r5 � kreis1849r� � isinstance�strr^ r_ r` ra )rR rV �raw�encoded�resultrn r! �reread_encodedr r r � test_encoding� s zTestStata.test_encodingc C s� t dgddddgd�}t dgdddd gd�}d |j_|�tj�}t�� �D}t�t �� |� |d � W d Q R X | � |�}t� |� d �|� W d Q R X d S ) N)r r r r Zgoodu bädZ8numberZ%astringwithmorethan32characters______)r\ Zb_dZ_8number� astringwithmorethan32characters_r )r r r# rk ri r� r^ r_ �assert_produces_warningr r` rU ra r� )rR r� � formattedr! r� r r r �test_read_write_dta11� s z TestStata.test_read_write_dta11c C s� t dgddddddgd�}t dgd d d d d dgd�}d|j_|�tj�}t�� �f}tj dd��2}t� dt � |j |d |d� t |�dks�t�W d Q R X | �|�}t�|�d�|� W d Q R X d S )N)r r r r r� rz Z!astringwithmorethan32characters_1Z!astringwithmorethan32characters_2�+�-�short�delete)r\ r� Z _0astringwithmorethan32character�_Z_1_Z_short�_deleter T)r} r~ )rV r )r r r# rk ri r� r^ r_ r� r� r� r r` r� r� rU ra r� )rR rV r� r� r! r� r� r r r �test_read_write_dta12� s2 z TestStata.test_read_write_dta12c C s� t dtjd�}t dtjd�}t dtjd�}t|||d��}d|j_|}|d �tj �|d< t � � �,}|� |� | � |�}t �|�d�|� W d Q R X d S )Ni )r� i l )r� r� �int64r r� )r ri r� r� r� r r r# rk �float64r^ r_ r` rU ra r� )rR �s1�s2�s3r� r� r! r� r r r �test_read_write_dta13� s z TestStata.test_read_write_dta13r8 r$ r9 r: c C s� t | |�}| �|�}d|j_| �| j�}dddddg}x"|D ]}|| jddd�||< q<W |d �tj �|d< t j |d d d �|d < t � ||� t �� �6}|j|d d i|d � | �|�} t � | �d�|� W d Q R X d S )Nr �byte_�int_�long_�float_�double_T)r �numeric�date_tdZcoerce)�errors�td)rV )rh rU r r# r r7 �_convertrk ri rl r� � to_datetimer^ ra r_ r` r� ) rR rT r% rV rm rn �colsr� r! r� r r r � test_read_write_reread_dta14� s z&TestStata.test_read_write_reread_dta14r< r= r> r? c C s� | � | j�}|d �tj�|d< |d �tj�|d< |d �tj�|d< |d �tj�|d< |d �tj�|d< |d j t j dd�|d< t | |�}| � |�}t�||� d S ) Nr� r� r� r� r� r� )z%Y-%m-%d)�args)r r; rk ri r� r� r� rl r� �applyr �strptimerh rU r^ ra )rR rT rn rm r r r � test_read_write_reread_dta15 s z&TestStata.test_read_write_reread_dta15c C s~ t dgdgd�}tddddd�}d }t�� �H}|j||||d � t|��"}|jd ksXt�|j|ksft�W d Q R X W d Q R X d S ) N)r �variable)r\ i� r � � � zThis is a data file.)� time_stampr� rV z29 Feb 2000 14:21) r r r^ r_ r` r r r� r� )rR rV r� r r� r! �readerr r r �test_timestamp_and_label s z"TestStata.test_timestamp_and_labelc C sj t dgdgd�}d}t�� �D}d}tjt|d�� |j|||d� W d Q R X tj� |�r\t �W d Q R X d S )N)r r )r\ z01 Jan 2000, 00:00:00z"time_stamp should be datetime type)�match)r rV ) r r^ r_ �pytest�raises� ValueErrorr` r r! �isfiler� )rR rV r� r r! �msgr r r �test_invalid_timestamp% s z TestStata.test_invalid_timestampc C s� t t�t�d�d��}d|j_t�� �d}t�t �� |� |� W d Q R X | � |�}|� d�}t |j�}dd� }t||�|_t�||� W d Q R X d S )Ng 9@)r� r� r c S s t | d �S )Nr )�int)r� r r r �<lambda>: � z5TestStata.test_numeric_column_names.<locals>.<lambda>)r ri �reshape�aranger r# r^ r_ r� r r` rU r� r� r\ �mapra )rR r� r! r� r\ Zconvert_col_namer r r �test_numeric_column_names/ s z#TestStata.test_numeric_column_namesc C s� t t�d�tjd�}t t�d�tjd�}tj|d d d�< tj|dd d�< t||d��}d|j_t � � �4}|j ||d� | � |�}|� d�}t �||� W d Q R X d S )Ng @)r� r r )r� r� r )rV )r ri r rl r� rj r r r# r^ r_ r` rU r� ra )rR rV r� r� r� r! r� r r r �test_nan_to_missing_value> s z#TestStata.test_nan_to_missing_valuec C s� ddg}t t�t�d�d�|d�}d|j_t�� �D}|j|dd� | � |�}t j t |jjd �� |d W d Q R X W d Q R X d S ) Nr� r� g $@)r� r )r\ Zindex_not_writtenF)r] )r ) r ri r r r r# r^ r_ r` rU r r �KeyError)rR r\ r� r! r� r r r � test_no_indexL s zTestStata.test_no_indexc C sr t ddg�}t ddgtjd�}t||d��}d|j_t�� �,}|�|� | � |�}t� |� d�|� W d Q R X d S )Nr zA longer stringg �?g @)r� )r� r� r ) r ri r� r r r# r^ r_ r` rU ra r� )rR r� r� r� r! r� r r r �test_string_no_datesV s z TestStata.test_string_no_datesc C s t ddgtjd�}t ddgtjd�}t ddgtjd�}t ddgtjd�}t||||d��}d|j_t� � ��}t� t �� |� |� W d Q R X | � |�}|�� }t |d tjd�|d < t |d tjd�|d < t |d tjd�|d < t�|�d�|� W d Q R X d S ) Nr �c )r� � i� l ���� )�s0r� r� r� r r� r� r� )r ri r� r� r� r r r# r^ r_ r� r r` rU r� r� r� ra r� ) rR r# r� r� r� r� r! r� �modifiedr r r �test_large_value_conversion` s z%TestStata.test_large_value_conversionc C s� t tdddddd�g�}d|j_t�� �X}t�t�� |�|dd i� W d Q R X | � |�}|� � }d g|_ t� |� d�|� W d Q R X d S ) Ni� rp rq rr rs rt r r r� Z_0)r r r r# r^ r_ r� r r` rU r� r\ ra r� )rR r� r! r� r$ r r r �test_dates_invalid_columnr s z#TestStata.test_dates_invalid_columnc C s� t j�| jd�}t|�}ddddgddddgddddgg}t|�}ddd d g|_|d �tj �|d< |d �tj �|d< |d �tj �|d < |d �tj �|d < t � |�d�|� d S ) Nz S4_EDUC1.dtar r ���r r ZclustnumZpri_schlZpsch_numZpsch_dis)r r! r" r r r r\ rk ri r� r� rl r^ ra �head)rR �dpathr� Zdf0r r r �test_105~ s "zTestStata.test_105c C s4 t j�| jd�}t|�}|�� i ks(t�|�� d S )Nz S4_EDUC1.dta)r r! r" r r � value_labelsr� �close)rR r) r r r r � test_value_labels_old_format� s z&TestStata.test_value_labels_old_formatc C s� dddddddg}dd � |D �}t d d d d dd �gt|� }t|g|d�}d|j_t d d d d dd �t d d d �t d d d�t d d d�t d dd�t d dd�t d dd�g}t|g|d�}d|j_t�� �.}|�||� | �|�}t� |� d�|� W d Q R X d S )Nr� r� Ztwr^ Ztq�th�tyc S s i | ] }||�qS r r )r� r r r r � <dictcomp>� s z6TestStata.test_date_export_formats.<locals>.<dictcomp>i� rp rt rr rs )r\ r rq r ry rv ) r r� r r r# r^ r_ r` rU ra r� ) rR r\ Z conversionsr r� �expected_valuesrn r! r� r r r �test_date_export_formats� s$ z"TestStata.test_date_export_formatsc C sr t dgd ggdgd�}t dgdggdgd�}d|j_t�� �,}|�|� | �|�}t�|�d�|� W d Q R X d S )N�1Zfoo)r\ r� r ) r r r# r^ r_ r` rU ra r� )rR r� rn r! r� r r r �test_write_missing_strings� s z$TestStata.test_write_missing_strings� byteorder�>�<c C sH t dddgtjd�}t dddgtjd�}t dddgtjd�}t dddgtjd�}t dddgtjd�}t ddd gtjd�}t ddd gtjd�} t||||||| d ��} d | j_| � � } tj tj tj tj tj tj tj f} x*t| j| �D ]\} }| | �|�| | < q�W t�� �6}| j|||d � | �|�}|�d �}t�|| � W d Q R X d S )Nr r T)r� �d � i� i�� i���l �� )r# r� r� r� �s4�s5�s6r )r5 rV )r ri Zbool_Zuint8Zuint16Zuint32r r r# r� r� r� r� r� �zipr\ rk r^ r_ r` rU r� ra )rR r5 rV r# r� r� r� r: r; r< r� rn Zexpected_typesr �tr! r� r r r �test_bool_uint� s2 zTestStata.test_bool_uintc C s� t | j��}|�� }W d Q R X t | j��}|�� }W d Q R X d}d}xH|�� D ]<\}}||ksbt�||| ksrt�||ks~t�||ksNt�qNW d S )N)Zvar1Zvar2Zvar3)�label1�label2Zlabel3)r r@ r� rA �itemsr� )rR r� Zsr_115Zsr_117�keys�labels�k�vr r r �test_variable_labels� s z TestStata.test_variable_labelsc C s� d}i }x2|D ]*}t d| d| d| g�|dt|� < qW t|�}t�� ��}|j|dd� t|��p}|j}|j}|j } xVt || |�D ]F\} } } t | dd � �t | dd � �ks�t �t | dd � �| ks�t �q�W W d Q R X W d Q R X d S ) N)r r8 �� r r r �sF)r] r ���) r r� r r^ r_ r` r �typlistZvarlistZfmtlistr= r r� ) rR �str_lensrI �str_lenr� r! �srrK � variables�formatsr �fmt�typr r r �test_minimal_size_col� s ( $z TestStata.test_minimal_size_colc C s� d}i }x2|D ]*}t d| d| d| g�|dt|� < qW t|�}d}tjt|d��$ t�� �}|�|� W d Q R X W d Q R X d S )N)r rH i� r r r rI z�Fixed width strings in Stata \.dta files are limited to 244 \(or fewer\)\ncharacters\. Column 's500' does not satisfy this restriction\. Use the\n'version=117' parameter to write the newer \(Stata 13 and later\) format\.)r ) r r� r r r r r^ r_ r` )rR rL rI rM r� r r! r r r � test_excessively_long_string� s ( z&TestStata.test_excessively_long_stringc C sN d}t dggdgd�}t�� �*}|�|� t|�� }|j}W d Q R X W d Q R X dd� td�D �}|�dd � xN|D ]F}|| d }x4tdd �D ]&} t|d | �} | j || ks�t �q�W qrW tt � d d �d �} | j d ks�t �tt � d d�d �} | j dk�st �tt � dd�d �} | j d k�s&t �tt � dd�d �} | j dk�sJt �d S )N)r �h�lg r� )r\ c S s g | ]}d t d| � �qS )�.�a )�chr)r� �ir r r r� s z:TestStata.test_missing_value_generator.<locals>.<listcomp>� r rW r � z<fs s � z.zz<ds �s �) r r^ r_ r` r Z VALID_RANGE�range�insertr r� r� �struct�unpack) rR �typesr� r! r� Z valid_ranger1 r> �offsetrZ �valr r r � test_missing_value_generator s. z&TestStata.test_missing_value_generatorrB rC rD c s� dddddg}t d�}t|j�� ��g }x2td�D ]&� � �fdd �td �D �}|�|� q2W t||d �}tt| |�d d �}t � ||� d S )NZint8_Zint16_Zint32_Zfloat32_Zfloat64_�e r\ c s g | ]}t �� |d ��qS )r\ )r )r� �j)rZ rC r r r� 0 s z;TestStata.test_missing_value_conversion.<locals>.<listcomp>r� )r\ T)Zconvert_missing) r �sortedZMISSING_VALUESrC r] �appendr r rh r^ ra )rR rT r\ Zsmvr �rowrn rm r )rZ rC r � test_missing_value_conversion) s z'TestStata.test_missing_value_conversionc C s� ddddddg}ddddd d g}ddd dd d g}ddd dddg}ddddddg}ddddddg}g }x�t t|��D ]�}g } x�t d�D ]|} | dkr�| �t|| || || || || || �� q�| dkr�| �t|| dd�� q�| �t|| || || �� q�W |�| � qrW |�tjgd � dddddddg} tddd�|d d< tddd�|d d< tdd d�|d d < tddd�|d d < tdd d �|d d< tdd d� |d d< |d d < tddd� |d d < |d d< tdd d� |d d< |d d< |d d < td dd� |d d < |d d< t|| td �}t| j �} t| j �} t j || d!d"� t j || d!d"� d#d$� | D �}t � � �:}d%|j_|�||� | �|�}t j |�d%�|d!d"� W d Q R X d S )&Ni� i� i' r8 i� i� r rw r r� rx � rr r �; rv rz Zdate_tcr� Zdate_twZdate_tmZdate_tqZdate_thZdate_ty� r r ry r� � i� )r\ r� T)r� c S s i | ]}|d d� |�qS )r' Nr )r� r r r r r0 e s z,TestStata.test_big_dates.<locals>.<dictcomp>r )r] r� rh r r� r� r r� r rE rF r^ ra r_ r r# r` rU r� )rR �yr�mo�dd�hr�mm�ssrn rZ ri rf r\ r� r� Zdate_conversionr! r� r r r �test_big_dates7 s^ 2" , zTestStata.test_big_datesc C s� | � | j�}|d �tj�|d< |d �tj�|d< |d �tj�|d< |d �tj�|d< |d �tj�|d< |d j t j dd�|d< t | j d d �}t�||� t | j d d d �}| � | j�}|d j t j dd�|d< t�||� d S ) Nr� r� r� r� r� r� )z%Y-%m-%d)r T)r F)r Zpreserve_dtypes)r r; rk ri r� r� r� rl r� r r r r r? r^ ra )rR rn Z no_conversion� conversionr r r �test_dtype_conversionq s z TestStata.test_dtype_conversionc C sX | � | j�}|d �tj�|d< |d �tj�|d< |d �tj�|d< |d �tj�|d< |d �tj�|d< |d j t j dd�|d< dddg}|| }t | j d |d �}t�||� dddg}|| }t | j d |d �}t�||� d }tjt|d �� ddg}t | j d |d � W d Q R X d }tjt|d ��" ddddg}t | j d |d � W d Q R X d S )Nr� r� r� r� r� r� )z%Y-%m-%d)r T)r r\ z"columns contains duplicate entries)r zEThe following columns were not found in the Stata data set: not_found� not_found)r r; rk ri r� r� r� rl r� r r r r r? r^ ra r r r )rR rn r\ ZdroppedZ reorderedr r r r �test_drop_column� s0 zTestStata.test_drop_columnz;ignore:\nStata value:pandas.io.stata.ValueLabelTypeMismatchc s� t jddddddgddddddgdddddd gd d d d d d gd ddtjd dgdd dtjddgd d dtjd dgdddtjddgdddtjddgdddtjddgg ddddddgd�� � �� }tj� fd d �� D �dd �� d |j_|d � t �|d< |d � t �|d< x^|D ]V}|| �� }|� d �j }|� � }|dk�rD|j|d!d"�}|jjd d!d#� |||< �qW t�� �4}� j||d$� | �|�}|�d �}t�||� W d Q R X d S )%Nr� r� r r� r� r r� r� r r� r� r r� r� r� rz rv ru r� ry r� r� r� r� r� Z unlabeled)r\ c s g | ]}� | � d ��qS )r )rk )r� r� )r� r r r� � s z6TestStata.test_categorical_writing.<locals>.<listcomp>)�axisr r T)r� )r� )rV )r r� ri rj r� r� �concatr r# r r� rk r� Z as_orderedr� r� r� r^ r_ r` rU r� ra ) rR rV rn r� r� r� r! r� �resr )r� r �test_categorical_writing� sH z"TestStata.test_categorical_writingc s� t jdd gdd gdd gdd ggdgd�� tj� fdd �� D �d d �� t�� �.}d }tjt|d �� � � |� W d Q R X W d Q R X t jdgdgdgdgd ggdgd�� tj� fdd �� D �d d �� t� t �� � � |� W d Q R X d S )Nr i' r r �dZToo_long)r\ c s g | ]}� | � d ��qS )r )rk )r� r� )r� r r r� � s zBTestStata.test_categorical_warnings_and_errors.<locals>.<listcomp>r )rz zbStata value labels for a single variable must have a combined length less than 32,000 characters\.)r c s g | ]}� | � d ��qS )r )rk )r� r� )r� r r r� � s ) r r� r� r{ r^ r_ r r r r` r� r )rR r! r r )r� r �$test_categorical_warnings_and_errors� s " z.TestStata.test_categorical_warnings_and_errorsc s� dd� t d�D �}|�tjg� tj|dgd�� tj� fdd�� D �dd�� d � j_ t � � �t}� j ||d � | � |�}|�d �}� �� }x6|D ].}|| j}|�� j} |j| d d �}|||< q�W t �||� W d Q R X d S ) Nc S s g | ]}d t |� g�qS )r )r� )r� rZ r r r r� s zHTestStata.test_categorical_with_stata_missing_values.<locals>.<listcomp>�x Z many_labels)r\ c s g | ]}� | � d ��qS )r )rk )r� r� )r� r r r� s r )rz r )rV T)r� )r] rh ri rj r r� r� r{ r r# r^ r_ r` rU r� r� r� �remove_unused_categoriesr� r� ra ) rR rV �valuesr! r� r| rn r� r� Znew_catsr )r� r �*test_categorical_with_stata_missing_values s" z4TestStata.test_categorical_with_stata_missing_valuesrG rH c C s� dddddddgt �d�fdd dddddgt �d�d d d � fdd dddddgt �d d dddg�fdddddddgt �dd�fdddddgt �dd d d d g�fdddddddgt �d�fdddd dddgt �d�fg}g }xP|D ]H\}}}}|�r|�|tjj||dd�f� q�|�|t|t jd �f� q�W t � t |��}t | |�}t |�}t�||� xV|D ]N}t|| j��r^t�|| jj|| jj� t�|| jj|| jj� �q^W d S ) NTr� r r r r~ �er� �reverserJ Znoorderr r r r r r� Z float_missingFZnolabelg �?g @g @g @g @Z int32_mixed)r� )r� )ri r �arrayrh r� � Categorical� from_codesr rl r � from_dict�dictrh r r^ ra r r� �assert_series_equalr� �codes�assert_index_equalr� ) rR rT rn r Zis_catr� rD r� rm r r r �test_categorical_order s, $$ z TestStata.test_categorical_orderrI rJ c C s� t t| |��}|jddd�}t�|jd �|_dddddddddd g }d d d d dg}tjj ||dd�}t |dd�}t � ||d � d S )NZsrh�first)Z na_positionr rJ r r r r ZPoorZFairZGoodz Very goodZ ExcellentT)r� r� r� )r# ) r rh Z sort_valuesri r �shaper r� r� r� r r^ r� )rR rT rm r� r� r� rn r r r �test_categorical_sorting; s z"TestStata.test_categorical_sortingc C s` t | |�}t|�}t|dd�}x<|D ]4}t|| j�s8q$|| jjsHt�|| jjr$t�q$W d S )NF)�order_categoricals)rh r r r� r� r� r� )rR rT rm Zparsed_unorderedr� r r r �test_categorical_orderingL s z#TestStata.test_categorical_orderingr+ rA rF � chunksizer r �convert_categoricalsFr c C s� t | |�}tjdd�� }t�d� t|||d�}W d Q R X t|d||d�}d} x�td�D ]�} tjdd��6}t�d� y|�|�} W n tk r� P Y nX W d Q R X |j| | | �d d �f � � } | � | �} t j | | ddd � | |7 } qXW |� � d S ) NT)r} r~ )r� r )�iteratorr� r r r� F)r� r� )rh r� r� r� r r] �read� StopIteration�ilocr� �_convert_categoricalr^ ra r, ) rR rT r� r� r �fnamer� rm �itr�posrf �chunk� from_framer r r �test_read_chunks_117X s4 z TestStata.test_read_chunks_117)r� �returnc C sZ xT| D ]L}| | }t |j�r|j�� }|jjtkrJt�|jj�}|�|�}|| |< qW | S )zX Emulate the categorical casting behavior we expect from roundtripping. ) r r� r� r� r� r� r� �Indexr� )r� r� Zserr� r� r r r r� � s z TestStata._convert_categoricalc C s@ | j }t|�}t|dd��.}|�d�}t�|jdd�d d �f |� W d Q R X t|dd��0}t|�}t�|jdd�d d �f |d � W d Q R X t|dd��.}|�d�}t�|jdd�d d �f |� W d Q R X t|dd��,}|�� }t�|jdd�d d �f |� W d Q R X t|dd��}t� |�}W d Q R X t�||� d S )NT)r� r� r )r� r ) r/ r r� r^ ra r� r� Z get_chunkr� r{ )rR r� rm r� r� Z from_chunksr r r � test_iterator� s" (, ((zTestStata.test_iteratorr* r@ rE c C s� t | |�}tjdd�� }t�d� t|||d�}W d Q R X t|d||d�}d} x�td�D ]�} tjdd��6}t�d� y|�|�} W n tk r� P Y nX W d Q R X |j| | | �d d �f � � } | � | �} t j | | ddd � | |7 } qXW |� � d S ) NT)r} r~ )r� r )r� r r� r r� F)r� r� )rh r� r� r� r r] r� r� r� r� r� r^ ra r, ) rR rT r� r� r r� r� rm r� r� rf r� r� r r r �test_read_chunks_115� s4 z TestStata.test_read_chunks_115c C s� | j }dddg}d}t||d�}t|dd��f}d}xZtd �D ]N}|j||d�}|d krXP |j||| �d d �f } tj| |d d � ||7 }q<W W d Q R X d S ) Nr� Zcpi�m1r )r\ T)r� r r� F)r� )r/ r r] r� r� r^ ra ) rR r� r\ r� rm r� r� rf r� r� r r r �test_read_chunks_columns� s z"TestStata.test_read_chunks_columnsc C s� d|j _dddd�}t�� �L}|j|||d� t|��}|�� }W d Q R X ddddd�}||ksdt�W d Q R X d |d< t�� �>}|j|||d� t|��}|�� }W d Q R X ||ks�t�W d Q R X d S ) Nr z City Rankz City Exponent�City)r r r )r� rV r� )r r r r z The Index)r r# r^ r_ r` r r� r� )rR rV r r� r! rN Z read_labelsZexpected_labelsr r r �test_write_variable_labels s" z$TestStata.test_write_variable_labelsc C sZ d|j _dddd�}t�� �4}d}tjt|d�� |j|||d� W d Q R X W d Q R X d S ) Nr zZvery longvery longvery longvery longvery longvery longvery longvery longvery longvery longz City Exponentr� )r r r z.Variable labels must be 80 characters or fewer)r )r� rV )r r# r^ r_ r r r r` )rR rV r r� r! r r r r � test_invalid_variable_labels s z&TestStata.test_invalid_variable_labelsc C s^ d|j _dddd�}d|d< t�� �0}tjtdd �� |j|||d � W d Q R X W d Q R X d S ) Nr zZvery longvery longvery longvery longvery longvery longvery longvery longvery longvery longz City Exponentr� )r r r u invalid character Œr z,Variable labels must contain only characters)r )r� rV )r r# r^ r_ r r r r` )rR rV r r� r! r r r �$test_invalid_variable_label_encoding$ s z.TestStata.test_invalid_variable_label_encodingc C s� ddddddg}ddd� |�d �}d }tjt|d ��( t�� �}|j||d � W d Q R X W d Q R X ddd d �}d}tjt|d ��( t�� �}|j||d � W d Q R X W d Q R X d S )Nu Ρu Αu Νu Δu Σz City Rankz City Exponentr� )r r r zKVariable labels must contain only characters that can be encoded in Latin-1)r )r� zqA very, very, very long variable label that is too long for Stata which means that it has more than 80 charactersz.Variable labels must be 80 characters or fewer)r" r r r r^ r_ r` )rR r r� Zvariable_labels_utf8r r! Zvariable_labels_longr r r � test_write_variable_label_errors1 s " z*TestStata.test_write_variable_label_errorsc C s t �ddddddd�t �ddddddd�t �dd d d d d d �g}td d dgdddg|d��}t�� ��}|j|dd� t|dd�}t�||� |j|dddid� t|dd�}t�||� |j� � � d�}|j|d|did� t|dd�}t�||� W d Q R X d S )Ni� rw rx i�. i� r iR i� rv r i� g �?g @g @�apple�banana�cherry)�nums�strs�datesF)r] T)r r� r� )r] r ) �dtr r r^ r_ r` r ra r\ �tolistr )rR r� r� r! �reread�directZ dates_idxr r r � test_default_date_conversionO s$ z&TestStata.test_default_date_conversionc C sP t dddgi�}d}tjt|d��$ t�� �}|�|� W d Q R X W d Q R X d S )Nr y �? @y @ @z"Data type complex128 not supported)r )r r r �NotImplementedErrorr^ r_ r` )rR r� r r! r r r �test_unsupported_typel s z TestStata.test_unsupported_typec C s t �ddddddd�t �ddddddd�t �dd d d d d d �g}td d dgdddg|d��}d}tjt|d��, t�� �}|j|ddid� W d Q R X W d Q R X t j dddd�}td d dgdddg|d��}tjtd d��$ t�� �}|�|� W d Q R X W d Q R X d S ) Ni� rw rx i�. i� r iR i� rv r i� g �?g @g @r� r� r� )r� r� r� zFormat %tC not implemented)r r� ZtC)r z1-1-1990r zAsia/Hong_Kong)Zperiods�tzzData type datetime64) r� r r r r r� r^ r_ r` r� Z date_range)rR r� r� r r! r r r �test_unsupported_datetypet s& & z#TestStata.test_unsupported_datetypec C s0 d}t jt|d�� t| jdd� W d Q R X d S )Na* Value labels for column ethnicsn are not unique. These cannot be converted to pandas categoricals. Either read the file with `convert_categoricals` set to False or use the low level interface in `StataReader` to separately read the values and the value_labels. The repeated labels are: -+ wolof )r T)r� )r r r r rM )rR r r r r �test_repeated_column_labels� s z%TestStata.test_repeated_column_labelsc C s� t | j�}tdddddddtjddg ddddtjdddddg dtjddddddddg dd d d d d ddddg d��}|ddddg }t�||� d S )Nr r r r r r� rz r r r r~ r� r� �grU rZ rf )r� r� r� r� r� r� r� r� )r rN r ri �NaNr^ ra )rR r� r� r r r �test_stata_111� s zTestStata.test_stata_111c C s� t dt�tj�jdgdt�tj�jt�tj�jgd��}d}tjt|d��$ t � � �}|� |� W d Q R X W d Q R X tj |j d< d}tjt|d��$ t � � �}|� |� W d Q R X W d Q R X d S )Ng g �)�ColumnOk� ColumnTooBigzZColumn ColumnTooBig has a maximum value \(.+\) outside the range supported by Stata \(.+\))r )r r� zaColumn ColumnTooBig has a maximum value of infinity which is outside the range supported by Stata)r ri �finfo�double�eps�maxr r r r^ r_ r` �infr� )rR r� r r! r r r �test_out_of_range_double� s $ z"TestStata.test_out_of_range_doublec C s t dt�tj�jt�tj�jd gdt�tj�jt�tj�jgd��}d|j_x |D ]}|| �tj�||< qTW t � � �>}|� |� t |�}|d �tj �|d< t �||�d�� W d Q R X tj|jd< d}tjt|d��$ t � � �}|� |� W d Q R X W d Q R X d S ) Ng g $@)r� r� r r� )r r� zaColumn ColumnTooBig has a maximum value of infinity which is outside the range supported by Stata)r )r ri r� rl r� r� r r# rk r^ r_ r` r r� ra r� r� r� r r r )rR r� r� r! r� r r r r �test_out_of_range_float� s( z!TestStata.test_out_of_range_floatc C s6 t �� }d|j_dd� }t �|j|�}t �||� d S )Nr c S s t | ��d�S )Nr )r r� )r� r r r r � r z-TestStata.test_path_pathlib.<locals>.<lambda>)r^ � makeDataFramer r# Zround_trip_pathlibr` ra )rR r� r r� r r r �test_path_pathlib� s zTestStata.test_path_pathlibc C s6 t �� }d|j_dd� }t �|j|�}t �||� d S )Nr c S s t | ��d�S )Nr )r r� )r� r r r r � r z6TestStata.test_pickle_path_localpath.<locals>.<lambda>)r^ r� r r# Zround_trip_localpathr` ra )rR r� r r� r r r �test_pickle_path_localpath� s z$TestStata.test_pickle_path_localpathr] c C s� ddddddgi}t |d�}|d �d�|d< t�� �4}|j||d� t|dd ��}|�� }W d Q R X W d Q R X |dddddd �iks�t�d S ) N�A�B�E�C)r r )r] T)r� )r r r r )r rk r^ r_ r` r r+ r� )rR r] r~ r� r! Zdta_iterr+ r r r �test_value_labels_iterator� s z$TestStata.test_value_labels_iteratorc C sJ t �� }d|j_t �� � }|�|� t|dd�}W d Q R X t �||� d S )Nr )� index_col)r^ r� r r# r_ r` r ra )rR r� r! r� r r r �test_set_index s zTestStata.test_set_index�column�ms�day�week�monthZqtrZhalfro c C s: t | j�}|jd|f }|jd|d f }||ks6t�d S )Nr �_fmt)r rQ r� r� )rR r� r� Z unformattedr� r r r �(test_date_parsing_ignores_format_details s z2TestStata.test_date_parsing_ignores_format_detailsc C sN t dddddddt�d�dddd dg d d dddddt�d �d d ddg gddddddddddddg d�}t|d td�|d< t|d tjd�|d< t|d tjd�|d< |d �tj�|d< t|d tj d�|d< d|j _ |j �tj�|_ |� � }t �� �J}|j|dd idgd d � | �|�}t j|�d�|d d � t �||� W d Q R X d S )!Nr� r� r g�������?z 2003-12-25r A� aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaai� zstring-1zobject-1z 2003-12-26r A� bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbr� r� r� r� rl r� r r� Zs2045ZsrtlZ forced_strl)r r\ )r� r r� rX )r � convert_strlrV F)r� )r ri r� r r� r� r� rk r� rl r r# r� r^ r_ r` rU ra r� )rR r� r� r! r� r r r �test_writer_117% sr zTestStata.test_writer_117c C s� t dddgdddggddd gd �}d |j_t�t��Z t�� �F}|j|dd gd d � | �|�}|� d �}|j |_ tj ||dd� W d Q R X W d Q R X d S )NA� aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaar� r� A� bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbr� r� Z2long1long1long1long1long1long1long1long1long1long1�longr )r\ r rX )r� rV F)r� ) r r r# r^ r� r r_ r` rU r� r\ ra )rR r� r! r� r r r �test_convert_strl_name_swapl s z%TestStata.test_convert_strl_name_swapc C s� t �ddddddd�t �ddddddd�t �dd d d d d d �g}td d dgdddg|d��}t�� �6}d}tjt|d�� |j|ddid� W d Q R X W d Q R X d S )Ni� rw rx i�. i� r iR i� rv r i� g �?g @g @r� r� r� )r� r� r� z0convert_dates key must be a column or an integer)r Z wrong_namer� )r ) r� r r r^ r_ r r r r` )rR r� r� r! r r r r � test_invalid_date_conversion{ s z&TestStata.test_invalid_date_conversionc C s� t �� }t�� }d|j_t�� �N}|j||d� |�d� t |d��}|� |� � � W d Q R X t |dd�}W d Q R X t� ||� d S )Nr )rV r �wb)r� )r �BytesIOr^ r� r r# r_ r` �seek�open�writer� r ra )rR rV Zbior� r! �dtar� r r r �test_nonfile_writing� s z TestStata.test_nonfile_writingc C s~ t �� }d|j_t �� �P}t�|d��}|j|dd� W d Q R X t�|d��}t|dd�}W d Q R X W d Q R X t � ||� d S )Nr r� rW )rV �rb)r� ) r^ r� r r# r_ �gzip�GzipFiler` r ra )rR r� r! �gzr� r r r �test_gzip_writing� s zTestStata.test_gzip_writingc C s� | � | j�}dddddg}dddddgd d d d d gd d dd dgdddddgddd dd gdddddgdddddgg}t||d�}t�||� d S )N�utf8�latin1�asciiZ utf8_strlZ ascii_strlu ραηδαςu PÄNDÄS�pu ƤĀńĐąŜ� Ör u ᴘᴀᴎᴅᴀS� Ü�nz r~ � r� rI )r\ )rU rO r r^ ra )rR Z unicode_dfr\ r� rn r r r �test_unicode_dta_118� s z TestStata.test_unicode_dta_118c C s� ddd�d dd�g}t |�}|j�d�|_t�� �x}|j|ddd� t|�}|�d �}t�||� d |j d d �d f< |j|dd gdd � t|�}|�d �}t�||� W d Q R X d S ) NA� stringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringstringr )�mixed�numberr r� FrX )r] rV r� r� )r] r� rV ) r r� rk r^ r_ r` r �fillnara r� )rR �outputr! r� rn r r r �test_mixed_string_strl� s z TestStata.test_mixed_string_strlc C sn ddd�d dd�g}t |�}d |jd d �df< t�� �.}tjtdd�� |j||d� W d Q R X W d Q R X d S )N�noner )r� r� r z Column `none` cannot be exported)r )rV )r r� r^ r_ r r r r` )rR rV r� r! r r r �test_all_none_exception� s z!TestStata.test_all_none_exceptionc C sx d}t |gdgd�}t�� �R}d}d}tjt|� d|� �d��& t�t�� |�|� W d Q R X W d Q R X W d Q R X d S )Nu9 Here is one __�__ Another one __·__ Another one __½__�invalid)r\ z\'latin-1' codec can't encode character '\\ufffd' in position 14: ordinal not in range\(256\)zP'ascii' codec can't decode byte 0xef in position 14: ordinal not in range\(128\)�|)r ) r r^ r_ r r �UnicodeEncodeErrorr� �ResourceWarningr` )rR rV �contentr� r! Zmsg1Zmsg2r r r � test_invalid_file_not_written� s z'TestStata.test_invalid_file_not_writtenc C s� t dgd dgd gddgd�}t�� ��}|j|ddgd� t|d ���}|�� }d}|�d �|ksft�|�d �|ksxt�|�d �d d d� }xN|�d�d d � D ]8}|�d�d }||� d�d } t |�| d ks�t�q�W W d Q R X W d Q R X d S )N�pandasr u þâÑÐŧZvar_strZvar_strl)r\ rX )rV r� r� zlatin-1zutf-8s strlsr r' s GSO� � �) r r^ r_ r` r� r� �encoder� �split�findr� ) rR r� r! r� r� rn ZgsosZgsorc �sizer r r �test_strl_latin1� s zTestStata.test_strl_latin1c C sr d}t �t��8}t| j�}t|�dks*t�|d jjd |ksBt�W d Q R X t dggd dgd�}t � ||� d S )Na One or more strings in the dta file could not be decoded using utf-8, and so the fallback encoding of latin-1 is being used. This can happen when a file has been incorrectly encoded by Stata or some other software. You should verify the string values returned are correct.� r u Düsseldorfr� )r\ ) r^ r� �UnicodeWarningr r6 r� r� �messager r ra )rR r r� r� rn r r r �test_encoding_latin1_118� s "z"TestStata.test_encoding_latin1_118c C s� t �| jd��}t|�}W d Q R X |jdks0t�|jd dksBt�|jd dksTt�|jd dksft�|jd t�t d d d d d d ��ks�t�d S ) Nr� )r i� )r rz A� AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA)r rv g ��Q� @)r rJ r )r r i� rw r ) r� r� rP r r� r� r� r� � Timestampr )rR r� r� r r r �test_stata_119 s zTestStata.test_stata_119c C s t jdddgdd�}tdddd gd d d d gdddd ggddddgd�}||d< ddddd d�}d}|d �tj�|d< t�� ��}t|||dg|d|d�}|� � t |�}|d � d �|d< t� ||� t |�} | j|ks�t�| �� |ks�t�|j||dd � t |�} t� || � W d Q R X d S ) Nr u βu ĉT)r� g �?r u ᴬu ᴀ relatively long ŝtringg @r u ᴮr� g @r u ᴰ�strls)r\ u ᴐᴬᵀr� u ᵈᵉᵊu ᴎტჄႲႳႴႶႺz Long Strings)r u βu ĉr u ᴐᴬᵀu ᴅaᵀa-labelF)r� r� r� r] rV )rV r] )r� r� r rk ri r� r^ r_ r � write_filer r� ra r r� r� r� r` ) rR rV r� r r� r� r! �writerr� r Zreread_to_statar r r �test_utf8_writer sB zTestStata.test_utf8_writerc C s� t tjdtjd��}t�� �.}tjtdd�� t ||dd� W d Q R X W d Q R X t�� �.}tjtdd�� t ||dd� W d Q R X W d Q R X d S ) N)r i� )r� z"version must be either 118 or 119.)r rX )rV zYou must use version 119rY ) r ri Zzerosr� r^ r_ r r r r )rR r� r! r r r �test_writer_118_exceptionsA s " z$TestStata.test_writer_118_exceptions)^�__name__� __module__� __qualname__r �fixturerS rU r �mark� parametrizerb ro r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r r r r r% r& r* r- r2 r4 r? rG rS rT rd rj ru rw ry �filterwarningsr} r r� r� r� r� r� � staticmethodr r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r Zslowr r r r r r r r& = s� A < . ( % ! :!5 $ % ' " G ,r& rV �i �l �o �q rW c C sT |ddd�}t j�|d�}t j�|d| � d��}t|�}t|�}tj||dd� d S ) Nr r r zstata-compat-118.dtaz stata-compat-z.dtaF)r� )r r! r" r r^ ra )rV r Z data_base�ref�oldrn Zold_dtar r r �test_backward_compatK s r! rX rY rZ �use_dictTF�inferc C s� d}| r*| dkr|sdn| }|d|� �7 }| }|r6d}|rBd| i}t tj�dd�td �d �}d |j_t�|���}|j |||d � | dkr�t � |d ��} t � | �� �} W d Q R X n�| dkr�t�|d�� } t � | �| jd ��} W d Q R X nr| dk�r t� |d ��} t � | �� �} W d Q R X n@| dk�rNt� |d ��} t � | �� �} W d Q R X n| d k�r\|} t| d d�} t�| |� W d Q R X d S )Nz dta_inferred_compression.dtar� r� rW r# �methodry r r� )r\ r )rV � compressionr� r= �rr �bz2�xz)r� )r ri r� r� r� r r# r^ r_ r` r� r� r r� r� �zipfile�ZipFile�filelistr' �lzmar ra ) r% rV r" r# � file_name�file_extZcompression_argr� r! �comp�fpr� r r r �test_compressionU s: " r1 r$ r= r. r� c C s� d|� �}d}t tj�dd�td�d�}d|j_t�|���}| |d�}|j ||d � | d ksd|d kr�t � |d ��B}t |j �d ks�t�|j d j|ks�t�t�|�|j d ��}W d Q R X n|}t|dd�} t�| |� W d Q R X d S )Nztest.ztest.dtary r r� )r\ r )r$ � archive_name)r% r= r& r r )r� )r ri r� r� r� r r# r^ r_ r` r) r* r� r+ r� �filenamer r� r� r ra ) r$ r. r- r2 r� r! r% Zzpr0 r� r r r �test_compression_dicty s " r4 c C s� t dtdddddgdd�i�}d|j_t�� �t}|j|| d� t|d d d �}xPt|�D ]D\}}|� d�}d|kstt �t� |j |j j d | d |d � � qVW W d Q R X d S ) N�catsr r r r )r� r )rV r F)r� r� r )r r r r# r^ r_ r` r � enumerater� r� r� r5 r� )rV r� r! r rZ �blockr r r �test_chunked_categorical� s r8 c C s t j�| d�}dddddg}t|dd���}t�t��x xpt|�D ]d\}}t|j �|d| d|d � ksnt �|dk r�t � ddg�}n t � dg�}t�|j jj|� q@W W d Q R X W d Q R X t�t��& t|dd��}|�� }W d Q R X W d Q R X t|�}t�||� d S ) Nz stata-dta-partially-labeled.dtar r g @r )r� r r� )r r! r" r r^ r� r r6 r� r5 r� r� r� Z Float64Indexr� r� r� �__next__r ra ) r �dta_filer� r rZ r7 �idxZ large_chunkr� r r r � test_chunked_categorical_partial� s & * r< c C s� t j�| d�}tjtdd�� t|dd� W d Q R X tjtdd�� t|dd� W d Q R X tjtdd�� t|dd� W d Q R X d S )Nz stata-dta-partially-labeled.dtaz chunksize must be a positive)r rJ )r� r r� )r r! r" r r r r )r r: r r r �test_iterator_errors� s r= c s� ddgdgd � t � fdd�td�D ��} t�� ��}| j|dd � tjdddgd d �}t|d d ��d}x\t|�D ]P\}}x$td�D ]}t� |j | j |� q�W t� || j |d |d d � � qpW W d Q R X W d Q R X d S )NZc_labelZb_labelZa_labeli� c s" i | ]}t j� d d�d|� ��qS )T)r� r� )r� r� )r� rE )r� r r r0 � s z.test_iterator_value_labels.<locals>.<dictcomp>r F)r] r� )r� r8 )r� r )r r] r^ r_ r` r� r� r r6 r� �dtypesr� ra r� )r� r! rn r rf r� rZ r )r� r �test_iterator_value_labels� s r? c C s� t tdd� td�D ��tdd� td�D ��ggddgd�} t�� ��}tjtdd �� | j|d d � W d Q R X t|�}t t j t j gddgd �}t� |j |� |jd | jd ks�t�|jd t| jd �ks�t�W d Q R X d S )Nc s s | ]}d | V qdS )r Nr )r� rZ r r r � <genexpr>� s z&test_precision_loss.<locals>.<genexpr>�< �4 �big�little)r\ z&Column converted from int64 to float64)r F)r] )r )r rD )r rC )r �sumr] r^ r_ r� r r` r r ri r� r� r> r� r� �float)r� r! r� Z expected_dtr r r �test_precision_loss� s , rG c C s� t dddgdddggddgd d d gd �}d |j_t�� �l}|j|| d� t|| d d�}t�||� t�|| ��}t � |� � �}W d Q R X t|d d�}t�||� W d Q R X d S )Ng��~�Ϛ�?g9DܜJ�?g >�D�)�?g�.4�i�(@g33333�@g���̤�Ar� r� �X�Y�Z)r r\ r )r% )r% r� )r� ) r r r# r^ r_ r` r ra Zdecompress_filer r� r� )r% r� r! r� �fh�contentsr r r �test_compression_roundtrip� s rM �to_infer� read_inferc C s� | }|dkrdn|}d|� �}t dddgddd ggd d gd d dgd�}d|j_|rVdn|}|rbdn|}t�|��.} |j| |d� t| |dd�} t�| |� W d Q R X d S )Nr� r� ztest.g��~�Ϛ�?g9DܜJ�?g >�D�)�?g�.4�i�(@g33333�@g���̤�Ar� r� rH rI rJ )r r\ r r# )r% )r% r� )r r r# r^ r_ r` r ra ) Zcompression_onlyrO rN r% �extr3 r� Zto_compressionZread_compressionr! r� r r r �test_stata_compression� s rQ )3r' r r� r� r r, r r_ r� r) �numpyri r Zpandas.core.dtypes.commonr r r� Zpandas._testingZ_testingr^ Zpandas.core.framer r Zpandas.io.parsersr Zpandas.io.statar r r r r r r r r r r r% r& r r r! r1 r4 r8 r< r= r? rG rM rQ r r r r �<module> sb ( "
| ver. 1.4 |
Github
|
.
| PHP 8.3.23 | Генерация страницы: 0.03 |
proxy
|
phpinfo
|
Настройка