CasperSecurity
U
yin5 � @ s� d Z ddlZddlZddlZddlZddlZddlmZ dddgZ ddd �Z
dd
d�Z dd� Z ddd�Z
ddd�Zdd� Zedkr�ee� �Ze�e� dS )a� Module/script to byte-compile all .py files to .pyc files.
When called as a script with arguments, this compiles the directories
given as arguments recursively; the -l option prevents it from
recursing into directories.
Without arguments, if compiles all modules on sys.path, without
recursing into subdirectories. (Even though it should do so for
packages -- for now, you'll have to deal with packages separately.)
See module py_compile for details of the actual byte-compilation.
� N)�partial� compile_dir� compile_file� compile_path�
c c s |dk r t | tj�r t�| �} |s0td�| �� zt�| �}W n. tk
rl |dk rdtd�| �� g }Y nX |�� |D ]�}|dkr�qztj �
| |�}|d k r�tj �
||�}nd }tj � |�s�||fV qz|dkrz|tj krz|tj
krztj � |�rztj �|�szt|||d |d�E d H qzd S )N� zListing {!r}...zCan't list {!r}� __pycache__r � )�ddir� maxlevels�quiet)�
isinstance�os�PathLike�fspath�print�format�listdir�OSError�sort�path�join�isdir�curdir�pardir�islink� _walk_dir)�dirr
r r �names�name�fullname�dfile� r" � /usr/lib/python3.8/compileall.pyr s:
�
� �r F���r c
C s� d}
|dk rt d��|dkrFzddlm}
W n tk
rD d}Y nX t| |||d�} d} |dkr�|
dk r�|ppd}|
|d��0}
|
�tt|||||| d �| �}t|dd
�} W 5 Q R X n(| D ]"\}}t |||||||| �s�d } q�| S ) a Byte-compile all modules in the given directory tree.
Arguments (only dir is required):
dir: the directory to byte-compile
maxlevels: maximum recursion level (default 10)
ddir: the directory that will be prepended to the path to the
file as it is compiled into each byte-code file.
force: if True, force compilation, even if timestamps are up-to-date
quiet: full output with False or 0, errors only with 1,
no output with 2
legacy: if True, produce legacy pyc paths instead of PEP 3147 paths
optimize: optimization level or -1 for level of the interpreter
workers: maximum number of parallel workers
invalidation_mode: how the up-to-dateness of the pyc will be checked
Nr z%workers must be greater or equal to 0r )�ProcessPoolExecutor)r r r
T)Z max_workers)�force�rxr �legacy�optimize�invalidation_mode)�defaultF)
�
ValueErrorZconcurrent.futuresr% � ImportErrorr �mapr �_compile_file_tuple�minr )r r r
r& r' r r( r) �workersr* r% Zfiles_and_ddirs�successZexecutorZresults�filer! r" r" r# r 2 sF
� �� �c K s | \}}t ||f|�S )z-Needs to be toplevel for ProcessPoolExecutor.)r )Zfile_and_dfile�kwargsr3 r! r" r" r# r/ e s r/ c
C s� d}|dk r"t | tj�r"t�| �} tj�| �} |dk rFtj�|| �}
nd}
|dk rd|�| �} | rd|S tj�| ��r�|r�| d } nB|dkr�|dkr�|nd}
t j
j | |
d�} n t j
� | �} tj� | �}| dd � | d d� }}|d
k�r�|�s\zXt
t�| �j�}t�d t j
jd|�}t| d ��}|�d
�}W 5 Q R X ||k�rB|W S W n tk
�rZ Y nX |�sptd�| �� z tj| | |
d||d�}W �n tjk
�r } zjd}|dk�r�| W Y �RS |�r�td�| �� n tddd� |jj t j j dd�}|� t j j �}t|� W 5 d}~X Y n� t!t"tfk
�r� } zRd}|dk�rJ| W Y �:S |�r`td�| �� n tddd� t|j#j$d |� W 5 d}~X Y nX |dk�r�d}|S )aT Byte-compile one file.
Arguments (only fullname is required):
fullname: the file to byte-compile
ddir: if given, the directory name compiled in to the
byte-code file.
force: if True, force compilation, even if timestamps are up-to-date
quiet: full output with False or 0, errors only with 1,
no output with 2
legacy: if True, produce legacy pyc paths instead of PEP 3147 paths
optimize: optimization level or -1 for level of the interpreter
invalidation_mode: how the up-to-dateness of the pyc will be checked
Tr N�cr r � )� optimization���z.pyz<4sll�rb� zCompiling {!r}...)r) r* Fz*** Error compiling {!r}...z*** )�end�backslashreplace)�errors�:)%r
r r r r �basenamer �search�isfile� importlib�util�cache_from_source�dirname�int�stat�st_mtime�structZpack� MAGIC_NUMBER�open�readr r r �
py_compile�compile�PyCompileError�msg�encode�sys�stdout�encoding�decode� SyntaxError� UnicodeError� __class__�__name__)r r
r& r' r r( r) r* r2 r r! Zmo�cfileZoptZ cache_dir�head�tail�mtimeZexpectZchandleZactual�ok�errrP �er" r" r# r j s�
�
�
�
�
$
c C sT d}t jD ]D}|r |tjkr2| r2|dk rNtd� q
|oLt||d|||||d�}q
|S )a� Byte-compile all module on sys.path.
Arguments (all optional):
skip_curdir: if true, skip current directory (default True)
maxlevels: max recursion level (default 0)
force: as for compile_dir() (default False)
quiet: as for compile_dir() (default 0)
legacy: as for compile_dir() (default False)
optimize: as for compile_dir() (default -1)
invalidation_mode: as for compiler_dir()
Tr zSkipping current directoryN)r r( r) r* )rR r r r r r ) Z skip_curdirr r& r r( r) r* r2 r r" r" r# r � s
�
c
C s� ddl } | jdd�}|jdddddd d
� |jd td d
d� |jddddd� |jdddddd� |jddddd� |jd d d dd d � |jd!d"d#dd$d � |jd%d&d'd(d)� |jd*d+d,d-d.� |jd/d0d1td2d3� d4d5� tjD �}|jd6t|�d7d8� |�� }|j}|j �r$ddl
}|� |j �|_ |j dk �r8|j }n|j
}|j�r�zF|jd9k�rZtjnt|j�� }|D ]}|�|�� � �qjW 5 Q R X W n4 tk
�r� |jd:k �r�td;�|j�� Y d<S X |j�r�|j�d9d=��� } tj| }
nd}
d>} z�|�rl|D ]h} tj � | ��r6t | |j |j |j |j|j!|
d?��sbd<} n,t"| ||j |j |j |j|j!|j#|
d@� �s�d<} �q�| W S t$|j!|j |j|
dA�W S W n, t%k
�r� |jd:k �r�tdB� Y d<S X d>S )CzScript main program.r Nz1Utilities to support installing Python libraries.)Z descriptionz-lZ store_constr r z!don't recurse into subdirectories)�actionZconstr+ �dest�helpz-r� recursionzhcontrol the maximum recursion level. if `-l` and `-r` options are specified, then `-r` takes precedence.)�typerb rc z-f�
store_truer& z/force rebuild even if timestamps are up to date)ra rb rc z-q�countr zIoutput only error messages; -qq will suppress the error messages as well.)ra rb r+ rc z-br( z0use legacy (pre-PEP3147) compiled file locationsz-dZDESTDIRr
z�directory to prepend to file paths for use in compile-time tracebacks and in runtime tracebacks in cases where the source file is unavailable)�metavarrb r+ rc z-xZREGEXPr' zskip files matching the regular expression; the regexp is searched for in the full path of each file considered for compilationz-iZFILE�flistzzadd all the files and directories listed in FILE to the list considered for compilation; if "-", names are read from stdin)rh rb rc � compile_destzFILE|DIR�*zrzero or more file and directory names to compile; if no arguments given, defaults to the equivalent of -l sys.path)rh �nargsrc z-jz --workersr zRun compileall concurrently)r+ re rc c S s g | ]}|j �� �d d��qS )�_�-)r �lower�replace)�.0�moder" r" r# �
<listcomp> s �zmain.<locals>.<listcomp>z--invalidation-modez�set .pyc invalidation mode; defaults to "checked-hash" if the SOURCE_DATE_EPOCH environment variable is set, and "timestamp" otherwise.)�choicesrc rn r zError reading file list {}Frm T)r* )r1 r* )r( r& r r* z
[interrupted])&�argparse�ArgumentParser� add_argumentrF rM �PycInvalidationMode�sorted�
parse_argsrj r' �rerN rd r ri rR �stdinrK �append�stripr r r r r* rp �upperr r rA r r
r& r( r r1 r �KeyboardInterrupt)
ru �parserZinvalidation_modes�argsZ
compile_destsr{ r �f�lineZivl_moder* r2 rb r" r" r# �main� s� �
�
�
� �
� � �
�
�
��� �
�
� r� �__main__)Nr r ) r NFNr Fr$ r N)NFNr Fr$ N)r r Fr Fr$ N)�__doc__r rR �importlib.utilrB rM rI � functoolsr �__all__r r r/ r r r� rY rF Z exit_status�exitr" r" r" r# �<module> s<
�
3 �
V �
"i