o
�j�� � @ s" d Z ddlmZ ddlZddlZeed�r=ddlmZ zddlm Z
W n e y2 ddlm
Z
Y nw dZ G d d
� d
�Z
n d Z dd lmZ
d
d� ZddlmZmZmZmZmZ ddlmZmZ dZdZdZdZ dZ dZ dZ dZ dZ!dZ"dZ#e$e%fdd�Z&dd� Z'dd � Z(d Z)i d de)e!f�d dd e!f�d!dd"e!f�d#dd$e"f�d%dd&e"f�d'dd(e"f�d)d*�d+d,�d-de)f�d.d/�d0d1�d2d3�d4d5�d6d7�d8d9�d:d;�d<dd=e"f�dd>e"fdd?e"fd@dAe"fdBdCe"fde)e fdd e fdd"e fdd e fdd"e fdd e fdd"e fdD� �Z*G dEdF� dF�Z+G dGdH� dH�Z,dS )Iz.Fallback pure Python implementation of msgpack� )�datetimeNZpypy_version_info)� newlist_hint)� BytesBuilder)�
StringBuilderTc @ s& e Zd Zd dd�Zdd� Zdd� ZdS )
�StringIO� c C s. |rt t|��| _| j�|� d S t � | _d S �N)r �len�builder�append��self�s� r �D/opt/saltstack/salt/lib/python3.10/site-packages/msgpack/fallback.py�__init__ s zStringIO.__init__c C s6 t |t�r
|�� }n t |t�rt|�}| j�|� d S r )�
isinstance�
memoryview�tobytes� bytearray�bytesr
r r r r r �write s
zStringIO.writec C �
| j �� S r )r
�build�r
r r r �getvalue! s
zStringIO.getvalueN)r )�__name__�
__module__� __qualname__r r r r r r r r s
r F)�BytesIOc C s g S r r )�sizer r r �<lambda>( s r! � )�
BufferFull� OutOfData� ExtraData� FormatError�
StackError)�ExtType� Timestamp� � � � i� c C s$ ||�|u r || �|v S || �|u S r r )�obj�t�type�tupler r r �_check_type_strict? s r2 c C s t | �}|jdkr
td��|S )Nr" z$cannot unpack from multi-byte object)r �itemsize�
ValueError)r. �viewr r r �_get_data_from_bufferF s
r6 c K sn t ddt| �i|��}|�| � z|�� }W n ty! td�� ty) t�w |�� r5t ||�
� ��|S )aw
Unpack an object from `packed`.
Raises ``ExtraData`` when *packed* contains extra bytes.
Raises ``ValueError`` when *packed* is incomplete.
Raises ``FormatError`` when *packed* is not valid msgpack.
Raises ``StackError`` when *packed* contains too nested.
Other exceptions can be raised during unpacking.
See :class:`Unpacker` for options.
N�max_buffer_sizez Unpack failed: incomplete inputr ) �Unpackerr �feed�_unpackr$ r4 �RecursionErrorr' �_got_extradatar% �_get_extradata)�packed�kwargsZunpacker�retr r r �unpackbM s
�rA � �� �� �>H�� �>I�� ZBb�� z>Hb�� z>Ib�� )r, z>f�� )� z>d�� �� )r* rE �� )r, rG �� )rM z>Q�� )r" �b�� )r* z>h�� )r, z>i�� )rM z>q�� Zb1sZb2sZb4srM Zb8s� Zb16s) �� �� �� �� �� �� �� �� �� �� �� c @ s� e Zd ZdZdddddddddddedddddfdd �Zd
d � Zd d
� Zdd� Zdd� Z dd� Z
d*dd�Z d*dd�Z dd� Z
efdd�Zd d � Zd d � ZeZd d!� Zd"d#� Zd$d%� Zd&d'� Zd(d)� ZdS )+r8 a Streaming unpacker.
Arguments:
:param file_like:
File-like object having `.read(n)` method.
If specified, unpacker reads serialized data from it and `.feed()` is not usable.
:param int read_size:
Used as `file_like.read(read_size)`. (default: `min(16*1024, max_buffer_size)`)
:param bool use_list:
If true, unpack msgpack array to Python list.
Otherwise, unpack to Python tuple. (default: True)
:param bool raw:
If true, unpack msgpack raw to Python bytes.
Otherwise, unpack to Python str by decoding with UTF-8 encoding (default).
:param int timestamp:
Control how timestamp type is unpacked:
0 - Timestamp
1 - float (Seconds from the EPOCH)
2 - int (Nanoseconds from the EPOCH)
3 - datetime.datetime (UTC).
:param bool strict_map_key:
If true (default), only str or bytes are accepted for map (dict) keys.
:param object_hook:
When specified, it should be callable.
Unpacker calls it with a dict argument after unpacking msgpack map.
(See also simplejson)
:param object_pairs_hook:
When specified, it should be callable.
Unpacker calls it with a list of key-value pairs after unpacking msgpack map.
(See also simplejson)
:param str unicode_errors:
The error handler for decoding unicode. (default: 'strict')
This option should be used only when you have msgpack data which
contains invalid UTF-8 string.
:param int max_buffer_size:
Limits size of data waiting unpacked. 0 means 2**32-1.
The default value is 100*1024*1024 (100MiB).
Raises `BufferFull` exception when it is insufficient.
You should set this parameter when unpacking data from untrusted source.
:param int max_str_len:
Deprecated, use *max_buffer_size* instead.
Limits max length of str. (default: max_buffer_size)
:param int max_bin_len:
Deprecated, use *max_buffer_size* instead.
Limits max length of bin. (default: max_buffer_size)
:param int max_array_len:
Limits max length of array.
(default: max_buffer_size)
:param int max_map_len:
Limits max length of map.
(default: max_buffer_size//2)
:param int max_ext_len:
Deprecated, use *max_buffer_size* instead.
Limits max size of ext type. (default: max_buffer_size)
Example of streaming deserialize from file-like object::
unpacker = Unpacker(file_like)
for o in unpacker:
process(o)
Example of streaming deserialize from socket::
unpacker = Unpacker()
while True:
buf = sock.recv(1024**2)
if not buf:
break
unpacker.feed(buf)
for o in unpacker:
process(o)
Raises ``ExtraData`` when *packed* contains extra bytes.
Raises ``OutOfData`` when *packed* is incomplete.
Raises ``FormatError`` when *packed* is not valid msgpack.
Raises ``StackError`` when *packed* contains too nested.
Other exceptions can be raised during unpacking.
Nr TFi @���c C s� |
d u rd}
|d u rd| _ nt|j�std��|| _d| _ t� | _d| _d| _| s+d} |
dkr1| }
|dkr7| }|dkr=| }|dkrE| d }|dkrK| }| | _ || j krWt
d ��|p^t | j d
�| _ t
|�| _t
|�| _|
| _|| _d| kr}d ks�t
d �� t
d ��|| _| | _|| _|| _| | _|
| _|| _|| _|| _|| _d| _ | d ur�t| �s�td
��|d ur�t|�s�td��|d ur�t|�s�td��|d ur�|d ur�td��t| �s�td��d S )N�strictTz!`file_like.read` must be callableFr i���rd r* z.read_size must be smaller than max_buffer_sizei @ r+ ztimestamp must be 0..3z`list_hook` is not callablez `object_hook` is not callablez#`object_pairs_hook` is not callablez8object_pairs_hook and object_hook are mutually exclusivez`ext_hook` is not callable) �_feeding�callable�read� TypeError� file_liker �_buffer�_buff_i�_buf_checkpoint�_max_buffer_sizer4 �min�
_read_size�bool�_raw�_strict_map_key�_unicode_errors� _use_list�
_timestamp�
_list_hook� _object_hook�_object_pairs_hook� _ext_hook� _max_str_len� _max_bin_len�_max_array_len� _max_map_len� _max_ext_len�_stream_offset)r
rj Z read_sizeZuse_list�raw� timestampZstrict_map_key� object_hook�object_pairs_hookZ list_hook�unicode_errorsr7 Zext_hookZ max_str_lenZ max_bin_lenZ
max_array_lenZ max_map_lenZ max_ext_lenr r r r � sr
��zUnpacker.__init__c C sr | j sJ �t|�}t| j�| j t|� | jkrt�| jdkr1| jd | j�= | j| j8 _d| _| j�|� d S �Nr ) rf r6 r rk rl rn r# rm �extend)r
Z
next_bytesr5 r r r r9 B s
z
Unpacker.feedc C s" | j | j| j 7 _ | j| _dS )z)Gets rid of the used parts of the buffer.N)r� rl rm r r r r �_consumeQ s zUnpacker._consumec C s | j t| j�k S r )rl r rk r r r r r< V � zUnpacker._got_extradatac C s | j | jd � S r )rk rl r r r r r= Y r� zUnpacker._get_extradatac C s | j |dd�}| �� |S )NF��raise_outofdata)�_readr� �r
�nr@ r r r �
read_bytes\ s zUnpacker.read_bytesc C s8 | j ||d� | j}| j||| � }|t|� | _|S )Nr� )�_reserverl rk r )r
r� r� �ir@ r r r r� a s
zUnpacker._readc C s� t | j�| j | }|dkrd S | jr| j| _t�| jdkr0| jd | j�= | j| j8 _d| _| }|t | j� | jkr?t�|dkrjt| j |�}| j
� |�}|sRnt |t
�sYJ �| j|7 _|t |�8 }|dksCt | j�|| j k r{|r}d| _t�d S d S r� )r rk rl rf rm r$ rn r# �maxrp rj rh r r )r
r� r� Z remain_bytesZ
to_read_bytesZ read_datar r r r� i s4
� �zUnpacker._reservec C s t }d}d }| �d� | j| j }| jd7 _|d@ dkr"|}�nd|d@ dkr0d|dA }�nV|d@ dkrS|d@ }t}|| jkrLt|� d | j� d
���| �|�}�n3|d @ d krq|d
@ }t}|| j krot|� d| j � d
����n|d @ dkr�|d
@ }t
}|| j kr�t|� d| j � d
����n�|dkr�d }�n�|dkr�d}�n�|dkr�d}�n�d| kr�dkr�n nBt | \}}}| �|� t
|�dkr�t�|| j| j�d }n| j| j }| j|7 _|| jkr�t|� d| j� d
���| �|�}�n�d| k�rdk�r9n n6t | \}}}| �|� t�|| j| j�\}}| j|7 _|| jk�r2t|� d| j� d
���| �|�}�nMd| k�rEd k�rtn n-t | \}}| �|� t
|�dk�ret�|| j| j�d }n| j| j }| j|7 _�nd | k�r�d k�r�n n4t | \}}}| j|k �r�t|� d| j� d
���| �|d � t�|| j| j�\}}| j|d 7 _n�d | k�r�d k�rn nBt | \}}}| �|� t
|�dk�r�t�|| j| j�\}n| j| j }| j|7 _|| jk�r t|� d | j� d
���| �|�}n�d!| k�rd"k�rCn n/t | \}}}| �|� t�|| j| j�\}| j|7 _|| j k�rBt|� d| j � d
���nCd#| k�rOd$k�r�n n/t | \}}}| �|� t�|| j| j�\}| j|7 _|| j k�rt|� d| j � d
���ntd%| ��|||fS )&Nr r" � �� rd � � � z exceeds max_str_len(�)�� � � z exceeds max_array_len(z exceeds max_map_len(� �� F�� TrC rF z exceeds max_bin_len(rH rJ z exceeds max_ext_len(rK rV rW r\ r] r_ r` ra rb rc zUnknown header: 0x%x)�TYPE_IMMEDIATEr� rk rl �TYPE_RAWr{ r4 r� �
TYPE_ARRAYr} �TYPE_MAPr~ �_MSGPACK_HEADERSr �struct� unpack_fromr| r r& )r
�typr� r. rS r �fmt�Lr r r � _read_header� s�
�
�
�
�
zUnpacker._read_headerc
sj � � � \}}}|tkr|tkrtd��|S |tkr#|tkr!td��|S |tkr_|tkr9t|�D ]}� �t� q/d S t |�}t|�D ]
}|�
� �t �� qA� j d urV� � |�}� j
r[|S t|�S |tkr�|tkrzt|�D ] }� �t� � �t� qkd S � jd ur�� �� fdd�t|�D ��}|S i }t|�D ]-}� �t �}� jr�t|�ttfvr�tdtt|�� ��t|t�r�t�|�}� �t �||< q�� jd ur͈ �|�}|S |tkr�d S |tkr� jr�t|�}|S |�d� j�}|S |t kr�t|�S |t k�r,|dk�r$t � t|��} � j dk�r| �!� S � j d k�r| �"� S � j d
k�r"| �#� S | S � �$|t|��S |t%k�s3J �|S ) NzExpected arrayz Expected mapc 3 s$ � | ]
}� � t�� � t�fV qd S r )r: � EX_CONSTRUCT)�.0�_r r r � <genexpr> s �
�z#Unpacker._unpack.<locals>.<genexpr>z %s is not allowed for map key�utf_8rd r" r* r+ )&r� �EX_READ_ARRAY_HEADERr� r4 �EX_READ_MAP_HEADERr� �EX_SKIP�ranger: r r r� rw ru r1 ry rs r0 �strr r �sys�internrx r� rr �decodert �TYPE_BIN�TYPE_EXTr) �
from_bytesrv Zto_unixZ to_unix_nanoZ to_datetimerz r� )
r
Zexecuter� r� r. r� r@ r� �key�tsr r r r: � s�
��
�
zUnpacker._unpackc C s | S r r r r r r �__iter__5 s zUnpacker.__iter__c C sD z | � t�}| �� |W S ty | �� t� ty! t�w r )r: r� r� r$ �
StopIterationr; r' �r
r@ r r r �__next__8 s
�zUnpacker.__next__c C s | � t� | �� d S r )r: r� r� r r r r �skipE s
z
Unpacker.skipc C s. z| � t�}W n ty t�w | �� |S r )r: r� r; r' r� r� r r r �unpackI s �zUnpacker.unpackc C � | � t�}| �� |S r )r: r� r� r� r r r �read_array_headerQ �
zUnpacker.read_array_headerc C r� r )r: r� r� r� r r r �read_map_headerV r� zUnpacker.read_map_headerc C s | j S r )r� r r r r �tell[ s z
Unpacker.tell)T)r r r �__doc__r( r r9 r� r< r= r� r� r� r� r� r: r� r� �nextr� r� r� r� r� r r r r r8 � sJ a
�[
" `J r8 c @ s� e Zd ZdZ d#dd�Zeeefdd�Zd d
� Z d d � Z
d
d� Z dd� Z dd� Z
dd� Zdd� Zefdd�Zdd� Zdd � Zd d � Zd d � Zd!d"� ZdS )$�Packera9
MessagePack Packer
Usage::
packer = Packer()
astream.write(packer.pack(a))
astream.write(packer.pack(b))
Packer's constructor has some keyword arguments:
:param default:
When specified, it should be callable.
Convert user type to builtin type that Packer supports.
See also simplejson's document.
:param bool use_single_float:
Use single precision float type for float. (default: False)
:param bool autoreset:
Reset buffer after each pack and return its content as `bytes`. (default: True).
If set this to false, use `bytes()` to get content and `.reset()` to clear buffer.
:param bool use_bin_type:
Use bin type introduced in msgpack spec 2.0 for bytes.
It also enables str8 type for unicode. (default: True)
:param bool strict_types:
If set to true, types will be checked to be exact. Derived classes
from serializable types will not be serialized and will be
treated as unsupported type and forwarded to default.
Additionally tuples will not be serialized as lists.
This is useful when trying to implement accurate serialization
for python types.
:param bool datetime:
If set to true, datetime with tzinfo is packed into Timestamp type.
Note that the tzinfo is stripped in the timestamp.
You can get UTC datetime with `timestamp=3` option of the Unpacker.
:param str unicode_errors:
The error handler for encoding unicode. (default: 'strict')
DO NOT USE THIS!! This option is kept for very specific usage.
Example of streaming deserialize from file-like object::
unpacker = Unpacker(file_like)
for o in unpacker:
process(o)
Example of streaming deserialize from socket::
unpacker = Unpacker()
while True:
buf = sock.recv(1024**2)
if not buf:
break
unpacker.feed(buf)
for o in unpacker:
process(o)
Raises ``ExtraData`` when *packed* contains extra bytes.
Raises ``OutOfData`` when *packed* is incomplete.
Raises ``FormatError`` when *packed* is not valid msgpack.
Raises ``StackError`` when *packed* contains too nested.
Other exceptions can be raised during unpacking.
NFTc C sV || _ || _|| _|| _t� | _t|�| _|pd| _|d ur&t |�s&t
d��|| _ d S )Nre zdefault must be callable) �
_strict_types�
_use_float�
_autoreset�
_use_bin_typer rk rq � _datetimert rg ri �_default)r
�defaultZuse_single_floatZ autoresetZ use_bin_typeZ strict_typesr r� r r r r � s
zPacker.__init__c C s� d}| j r
|}t}nttf} |dk rtd��|d u r!| j�d�S ||t�r4|r.| j�d�S | j�d�S ||t��r6d| krDdk rPn n
| j�t� d |��S d
| krZdk rfn n
| j�t� d |��S d| krpd kr}n n | j�t� d
d|��S d| kr�dk r�n n | j�t� dd|��S d | k r�dkr�n n | j�t� dd|��S d| kr�dk r�n n | j�t� dd|��S d| k r�dkr�n n | j�t� dd|��S d| kr�dk r�n n | j�t� d d |��S d| k r�d k�rn n | j�t� d d |��S d!| k�rdk �r!n n | j�t� d"d#|��S |�s2| j
d u�r2| �
|�}d}qt d$��||t t
f��r[t|�}|d%k�rPtd&t|�j ��| �|� | j�|�S ||t��r�|�d'| j�}t|�}|d%k�rutd(��| �|� | j�|�S ||t��r�|j}|d%k�r�td)��| �|� | j�|�S ||t��r�| j�r�| j�t� d*d+|��S | j�t� d,d-|��S ||ttf��rg||t��r�d.}|� � } n|j }|j } t |t��s�J �t | t ��s�J �t| �}
|
d/k�r�| j�d0� n]|
d1k�r| j�d2� nQ|
d3k�r| j�d4� nE|
d5k�r | j�d6� n9|
d7k�r(| j�d8� n-|
d k�r9| j�t� d9d:|
�� n |
dk�rJ| j�t� dd;|
�� n | j�t� dd<|
�� | j�t� d |�� | j�| � d S |||��r�t|�}| � |� t!|�D ]
} | �"|| |d/ � �qzd S ||t#��r�| �$t|�|�%� |d/ �S | j&�r�||t'��r�|j(d u�r�t�)|�}d/}q|�s�| j
d u�r�| �
|�}d/}q| j&�r�||t'��r�td=|�d>���t*d=|����)?NFTr zrecursion limit exceeded� �� �� �r� �Bi��rS r� ZBBrN i����z>BbrR � �>BHrO i ���z>BhrT � �� �>BIrP i �z>BirU l ���� z>BQrQ l���� z>BqrV zInteger value out of range� z%s is too largezutf-8zString is too largezMemoryview is too largez>BfrK z>BdrL rd r" � �r* � �r, � �rM � �rX � �>BBrH rI rJ zCannot serialize z where tzinfo=None)+r� �listr1 r4 rk r rq �intr� �packr� �
OverflowErrorr r r r0 r �_pack_bin_headerr� �encodert �_pack_raw_headerr �nbytes�floatr� r( r) �to_bytes�code�datar �_pack_array_headerr� �_pack�dict�_pack_map_pairs�itemsr� � _DateTime�tzinfoZ
from_datetimeri ) r
r. �
nest_limit�checkZcheck_type_strictZ default_usedZ
list_typesr� r� r� r� r� r r r r� � s�
z Packer._packc C s@ z| � |� W n t� | _� | jr | j�� }t� | _|S d S r )r� r rk r� r )r
r. r@ r r r r� 6 s
�z Packer.packc C s0 | � t|�|� | jr| j�� }t� | _|S d S r )r� r r� rk r r )r
�pairsr@ r r r �pack_map_pairsA s
�zPacker.pack_map_pairsc C �6 |dkrt �| �|� | jr| j�� }t� | _|S d S �Nr� )r4 r� r� rk r r r� r r r �pack_array_headerH �
�zPacker.pack_array_headerc C r� r� )r4 �_pack_map_headerr� rk r r r� r r r �pack_map_headerQ r� zPacker.pack_map_headerc C sN t |t�s td��d| krdkstd�� td��t |t�s$td��t|�}|dkr0td��|dkr;| j�d � nZ|d
krF| j�d � nO|d krQ| j�d
� nD|dkr\| j�d� n9|dkrg| j�d� n.|dkrx| j�dt� d|� � n |dkr�| j�dt� d|� � n | j�dt� d|� � | j�t� d|�� | j�|� d S )Nz typecode must have int type.r � ztypecode should be 0-127zdata must have bytes typer� zToo large datar" r� r* r� r, r� rM r� rX r� r� � �r� r� � �rE � �rG )
r r� ri r4 r r rk r r� r� )r
�typecoder� r� r r r �
pack_ext_typeZ s8
�
zPacker.pack_ext_typec C �d |dkr| j �t�dd| ��S |dkr | j �t�dd|��S |dkr.| j �t�dd |��S td
��) Nr� r� r� r� r� r` r� r� ra zArray is too large�rk r r� r� r4 �r
r� r r r r� w � zPacker._pack_array_headerc C r ) Nr� r� r� r� r� rb r� r� rc zDict is too larger r r r r r� � r zPacker._pack_map_headerc C s< | � |� |D ]\}}| �||d � | �||d � qd S )Nr" )r� r� )r
r� r� r� �k�vr r r r� � s
�zPacker._pack_map_pairsc C s� |dkr| j �t�dd| �� d S | jr&|dkr&| j �t�dd|�� d S |dkr7| j �t�dd |�� d S |d
krH| j �t�d d |�� d S td
��)Nr� r� r� r� r� r] r� r� r^ r� r� r_ zRaw is too large)rk r r� r� r� r4 r r r r r� � s zPacker._pack_raw_headerc C sr | j s| �|�S |dkr| j�t�dd|��S |dkr&| j�t�dd|��S |dkr5| j�t�dd |��S td
��) Nr� r� rC r� r� rD r� r� rF zBin is too large)r� r� rk r r� r� r4 r r r r r� � s
zPacker._pack_bin_headerc C r )z/Return internal buffer contents as bytes object)rk r r r r r r � s
z Packer.bytesc C s t � | _dS )zYReset internal buffer.
This method is useful only when autoreset=False.
N)r rk r r r r �reset� s z Packer.resetc C s t rt| �� �S | j�� S )z Return view of internal buffer.)�USING_STRINGBUILDERr r rk � getbufferr r r r r � s
zPacker.getbuffer)NFTTFFN)r r r r� r �DEFAULT_RECURSE_LIMITr r2 r� r� r� r� r� r r� r� r� r� r� r r r r r r r r� _ s6 F
�
�| r� )-r� r r� r� r� �hasattrZ__pypy__r Z__pypy__.buildersr r � ImportErrorr
r �ior �
exceptionsr# r$ r% r& r' �extr( r) r� r� r� r� r� r� r� r� r� r� r r0 r1 r2 r6 rA Z_NO_FORMAT_USEDr� r8 r� r r r r �<module> s�
�
�
�
�
�
�
��� �
� � �
����
�� [