CasperSecurity
o
�bt� � @ s� U d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl m
Z
m Z m Z ddl
mZ ddlmZmZmZ ddlmZ ddlmZ ddlmZmZ dd lmZm Z dd
l m Z dd l m Z e �!� rme"d ��zddl#Z$W n e"y~ dZ#Y nw e$Z#z
ddl%Z&ddl'Z'W n e"y� dZ%Y nw e&Z%ej(Z(i Z)e e*e
f e+d
< dd� Z,dd� Z-dd� Z.G dd� dej/�Z0G dd� dej/�Z1G dd� de�Z2G dd� d�Z3e3� Z4d d � Z5ee�G d d � d e2��Z6ee�G d d!� d!ej/e2��Z7dS )"z�
UNIX Process management.
Do NOT use this module directly - use reactor.spawnProcess() instead.
Maintainer: Itamar Shtull-Trauring
� N)�Callable�Dict�Optional)� implementer)�abstract�error�fdesc)� BaseProcess)�IProcessTransport)�CONNECTION_DONE�CONNECTION_LOST)�failure�log)�platform)� switchUIDz^twisted.internet.process does not work on Windows. Use the reactor.spawnProcess() API instead.�reapProcessHandlersc C s t t�� �D ]} | �� qdS )z(
Reap all registered processes.
N)�listr �values� reapProcess)�process� r �:/usr/lib/python3/dist-packages/twisted/internet/process.py�reapAllProcesses= s
�r c C s� | t v rtd��z t�| tj�\}}W n ty2 t�d| � d�� t�� | du r.Y dS d}Y nw |r<|� |� dS |t | < dS )z�
Register a process handler for the given pid, in case L{reapAllProcesses}
is called.
@param pid: the pid of the process.
@param process: a process handler.
z.Try to register an already registered process.�Failed to reap �:N)
r � RuntimeError�os�waitpid�WNOHANG�
BaseExceptionr �msg�err� processEnded)�pidr �auxPID�statusr r r �registerReapProcessHandlerG s � r& c C s& | t v r
t | |kstd��t | = dS )zd
Unregister a process handler previously registered with
L{registerReapProcessHandler}.
z+Try to unregister a process not registered.N)r r )r# r r r r � unregisterReapProcessHandlerb s
r' c @ sN e Zd ZdZdZdZdZddd�Zdd� Zd d
� Z d d � Z
d
d� Z dd� Z dS )�
ProcessWritera�
(Internal) Helper class to write into a Process's input pipe.
I am a helper which describes a selectable asynchronous writer to a
process's input pipe, including stdin.
@ivar enableReadHack: A flag which determines how readability on this
write descriptor will be handled. If C{True}, then readability may
indicate the reader for this write descriptor has been closed (ie,
the connection has been lost). If C{False}, then readability events
are ignored.
� r Fc C s� t j�| |� t�|� || _|| _|| _t� t
� | � � �j
�s$d| _n |r*d| _nz
t
�| � � d� W n ty@ d| _Y nw | jrJ| �� dS dS )zJ
Initialize, specifying a Process instance to connect to.
FTr N)r �FileDescriptor�__init__r �setNonBlocking�proc�name�fd�stat�S_ISFIFOr �fstat�fileno�st_mode�enableReadHack�read�OSError� startReading)�self�reactorr- r. r3 �
forceReadHackr r r r+ ~ s"
� �zProcessWriter.__init__c C � | j S )z<
Return the fileno() of my process's stdin.
�r/ �r9 r r r r3 � � zProcessWriter.filenoc C s, t �| j|�}|t|�kr| jr| �� |S �z6
Write some data to the open process.
)r � writeToFDr/ �lenr5 r8 )r9 �data�rvr r r �
writeSomeData� s zProcessWriter.writeSomeDatac C s | � � tj�| |� d S �N)� stopReadingr r* �write�r9 rC r r r rH � s zProcessWriter.writec C s | j rtS | �� dS )a�
The only way a write pipe can become "readable" is at EOF, because the
child has closed it, and we're using a reactor which doesn't
distinguish between readable and closed (such as the select reactor).
Except that's not true on linux < 2.6.11. It has the following
characteristics: write pipe is completely empty => POLLOUT (writable in
select), write pipe is not completely empty => POLLIN (readable in
select), write pipe's reader closed => POLLIN|POLLERR (readable and
writable in select)
That's what this funky code is for. If linux was not broken, this
function could be simply "return CONNECTION_LOST".
N)r5 r rG r> r r r �doRead� s zProcessWriter.doReadc C s. t �| j� tj�| |� | j�| j|� dS )z=
See abstract.FileDescriptor.connectionLost.
N) r � setBlockingr/ r r* �connectionLostr- �childConnectionLostr. �r9 �reasonr r r rL � s z ProcessWriter.connectionLostN)F)
�__name__�
__module__� __qualname__�__doc__� connected�icr5 r+ r3 rE rH rJ rL r r r r r( l s
r( c @ sL e Zd ZdZdZdd� Zdd� Zdd� Zd d
� Zd d � Z d
d� Z
dd� Z dS )�
ProcessReaderzx
ProcessReader
I am a selectable representation of a process's output pipe, such as
stdout and stderr.
Tc C s6 t j�| |� t�|� || _|| _|| _| �� dS )zA
Initialize, specifying a process to connect to.
N) r r* r+ r r, r- r. r/ r8 )r9 r: r- r. r3 r r r r+ � s
zProcessReader.__init__c C r< )z=
Return the fileno() of my process's stderr.
r= r> r r r r3 � r? zProcessReader.filenoc C s |dksJ �t S )N� )r rI r r r rE � s zProcessReader.writeSomeDatac C s t �| j| j�S )z@
This is called when the pipe becomes readable.
)r �
readFromFDr/ � dataReceivedr> r r r rJ � s zProcessReader.doReadc C s | j �| j|� d S rF )r- �childDataReceivedr. rI r r r rY � � zProcessReader.dataReceivedc C s> | j r| js d| _| �� | j�d| jt�t�� d S d S d S )Nr) r ) rT �
disconnectingrG r: � callLaterrL r
�Failurer r> r r r �loseConnection� s ��z ProcessReader.loseConnectionc C s" t j�| |� | j�| j|� dS )zk
Close my end of the pipe, signal the Process (which signals the
ProcessProtocol).
N)r r* rL r- rM r. rN r r r rL � z ProcessReader.connectionLostN) rP rQ rR rS rT r+ r3 rE rJ rY r_ rL r r r r rV � s rV c @ sl e Zd ZU dZdZee ed< dZdd� Z dd� Z
dd � Z d
d � Z d d
� Z
dd� Zdd� Zdefdd�ZdS )� _BaseProcessz0
Base class for Process and PTYProcess.
Nr% c
C s� z+z t �| jt j�\}}W n ty) } z|jtjkr d}n� W Y d}~nd}~ww W n tyD t� d| j� d�� t�
� d}Y nw |rSt || � | � |� dS dS )a
Try to reap a process (without blocking) via waitpid.
This is called when sigchild is caught or a Process object loses its
"connection" (stdout is closed) This ought to result in reaping all
zombie processes, since it will be called twice as often as it needs
to be.
(Unfortunately, this is a slightly experimental approach, since
UNIX has no way to be really sure that your process is going to
go away w/o blocking. I don't want to block.)
Nr r )
r r r# r r7 �errno�ECHILDr r r r! r' r" )r9 r# r% �er r r r s(
���� �
�z_BaseProcess.reapProcessc C sH d }}t �|�rt �|�}nt �|�}|s|r t�|||�S t�|�S rF )r � WIFEXITED� WEXITSTATUS�WTERMSIGr �ProcessTerminated� ProcessDone)r9 r% �exitCode�sigr r r �
_getReason6 s
z_BaseProcess._getReasonc
C sj |dv r t td|� ��}| jdu rt� �z
t�| j|� W dS ty4 } z
|jtjkr/t� �� d}~ww )a*
Send the given signal C{signalID} to the process. It'll translate a
few signals ('HUP', 'STOP', 'INT', 'KILL', 'TERM') from a string
representation to its int value, otherwise it'll pass directly the
value provided
@type signalID: C{str} or C{int}
)�HUP�STOP�INT�KILL�TERM�SIGN) �getattr�signalr# �ProcessExitedAlreadyr �killr7 rb �ESRCH)r9 �signalIDrd r r r �
signalProcess@ s
��z_BaseProcess.signalProcessc C s4 t dtj�D ]}t�|�tjkrt�|tj� qd S �Nr) )�rangert �NSIG� getsignal�SIG_IGN�SIG_DFL)r9 � signalnumr r r �_resetSignalDispositionU s
��z$_BaseProcess._resetSignalDispositionc K s& t �� }t �� zt�� | _W n ty |r t �� � w | jdkr�zt� d� | j
d i |�� | � ||||||� W nF ty� z3t j
t�dd�dd�} d�|t|�t|��}
| �|
� tj| d� | �� td �D ]} t�| � qmW n ty Y nw Y nw t�d
� |r�t �� d | _dS )
a�
Fork and then exec sub-process.
@param path: the path where to run the new process.
@type path: L{bytes} or L{unicode}
@param uid: if defined, the uid used to run the new process.
@type uid: L{int}
@param gid: if defined, the gid used to run the new process.
@type gid: L{int}
@param executable: the executable to run in a new process.
@type executable: L{str}
@param args: arguments used to create the new process.
@type args: L{list}.
@param environment: environment used for the new process.
@type environment: L{dict}.
@param kwargs: keyword arguments to L{_setupChild} method.
r N� �wbzutf-8)�encodingz)Upon execvpe {} {} in environment id {}
:��file� r) ���r )�gc� isenabled�disabler �forkr# r �enable�sys�settrace� _setupChild�
_execChild�io�
TextIOWrapper�fdopen�format�str�idrH � traceback� print_exc�flushr{ �close�_exitr% ) r9 �path�uid�gid�
executable�args� environment�kwargs�collectorEnabled�stderrr r/ r r r �_fork` sF �
�
� ���
*
z_BaseProcess._forkc O � t � �)zB
Setup the child process. Override in subclasses.
��NotImplementedError)r9 r� r� r r r r� � r? z_BaseProcess._setupChildc C sn |rt �|� |dus|dur.|du rt �� }|du r t �� }t �d� t �d� t||� t �|||� dS )z?
The exec() which is done in the forked child.
Nr )r �chdir�geteuid�getegid�setuid�setgidr �execvpe)r9 r� r� r� r� r� r� r r r r� � s
z_BaseProcess._execChild�returnc C s d� | jj| j| j�S )z5
String representation of a process.
z<{} pid={} status={}>)r� � __class__rP r# r% r> r r r �__repr__� s
�z_BaseProcess.__repr__)rP rQ rR rS r% r �int�__annotations__r# r rl ry r� r� r� r� r� r� r r r r ra s
_ra c @ sP e Zd ZdZejZejZeZdd� Z dd� Z
dd� Z dd � Z d
d � Z
d d
� ZdS )� _FDDetectorav
This class contains the logic necessary to decide which of the available
system techniques should be used to detect the open file descriptors for
the current process. The chosen technique gets monkey-patched into the
_listOpenFDs method of this class so that the detection only needs to occur
once.
@ivar listdir: The implementation of listdir to use. This gets overwritten
by the test cases.
@ivar getpid: The implementation of getpid to use, returns the PID of the
running process.
@ivar openfile: The implementation of open() to use, by default the Python
builtin.
c C s | j | j| jg| _d S rF )�_procFDImplementation�_devFDImplementation�_fallbackFDImplementation�_implementationsr> r r r r+ � s
�z_FDDetector.__init__c C s | � � | _| �� S )z�
Return an iterable of file descriptors which I{may} be open in this
process.
This will try to return the fewest possible descriptors without missing
any.
)�_getImplementation� _listOpenFDsr> r r r r� � s
z_FDDetector._listOpenFDsc C sp | j D ]2}z|� }W n ty Y qw | �dd�� |� }W d � n1 s(w Y ||kr5| S q|S )a�
Pick a method which gives correct results for C{_listOpenFDs} in this
runtime environment.
This involves a lot of very platform-specific checks, some of which may
be relatively expensive. Therefore the returned method should be saved
and re-used, rather than always calling this method to determine what it
is.
See the implementation for the details of how a method is selected.
z /dev/null�rN)r� r �openfile)r9 �impl�before�afterr r r r� s
� ��z _FDDetector._getImplementationc C s d}dd� | � |�D �}|S )z�
Simple implementation for systems where /dev/fd actually works.
See: http://www.freebsd.org/cgi/man.cgi?fdescfs
z/dev/fdc S � g | ]}t |��qS r �r� ��.0r/ r r r �
<listcomp>+ � z4_FDDetector._devFDImplementation.<locals>.<listcomp>)�listdir)r9 �dname�resultr r r r� % s z _FDDetector._devFDImplementationc C s" d| � � f }dd� | �|�D �S )zk
Simple implementation for systems where /proc/pid/fd exists (we assume
it works).
z /proc/%d/fdc S r� r r� r� r r r r� 4 r� z5_FDDetector._procFDImplementation.<locals>.<listcomp>)�getpidr� )r9 r� r r r r� . r` z!_FDDetector._procFDImplementationc C sH zddl }W n ty d}Y t|�S w td|�|j�d �}t|�S )au
Fallback implementation where either the resource module can inform us
about the upper bound of how many FDs to expect, or where we just guess
a constant maximum if there is no resource module.
All possible file descriptors from 0 to that upper bound are returned
with no attempt to exclude invalid file descriptor values.
r Ni r) )�resource� ImportError�min� getrlimit�
RLIMIT_NOFILEr{ )r9 r� �maxfdsr r r r� 6 s �z%_FDDetector._fallbackFDImplementationN)rP rQ rR rS r r� r� �openr� r+ r� r� r� r� r� r r r r r� � s r� c C s t �� S )zZ
Use the global detector object to figure out which FD implementation to
use.
)�detectorr� r r r r r� N s r� c @ s� e Zd ZdZdZdZdZdZeZ e
Z d+dd�Z dd� Z
d d
� Zd d � Zd
d� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Z d'd(� Z d)d*� Z dS ),�Processa�
An operating-system Process.
This represents an operating-system process with arbitrary input/output
pipes connected to it. Those pipes may represent standard input,
standard output, and standard error, or any other file descriptor.
On UNIX, this is implemented using fork(), exec(), pipe()
and fcntl(). These calls may not exist elsewhere so this
code is not cross-platform. (also, windows can only select
on sockets...)
Fr� Nc
sJ |sd| � � vs
J �d| � � vsJ �t�| |� i | _i }
| du r'dddd�} | j} | r1td| � g � � fdd�} i }
zw| �� D ]V\}}| rMtd| |� |dkri| � \}}| r`td ||f � ||
|< ||
|< q@|dkr�| � \}}| r|td ||f � ||
|< ||
|< q@t|�tks�J |�d
���||
|< q@| r�td |
� | r�td |
� | j |||||||
d
� W n t
y� � D ]} t � | � q�� w || _
|
�� D ]3\}}t � |
| � | | dkr�| �|| ||�}|| j|< | | dkr�| j|| ||dd�}|| j|< q�z| j
du�r
| j
�| � W n t
�y t�� Y nw t| j| � dS )�
Spawn an operating-system process.
This is where the hard work of disconnecting all currently open
files / forking / executing the new process happens. (This is
executed automatically when a Process is instantiated.)
This will also run the subprocess as a given user ID and group ID, if
specified. (Implementation Note: this doesn't support all the arcane
nuances of setXXuid on UNIX: it will assume that either your effective
or real UID is 0.)
r� �wN)r r) r� �childFDsc s" t �� \} }� �| |g� | |fS rF )r �pipe�extend)r� r� �� _openedPipesr r r� � s z Process.__init__.<locals>.pipez[%d]zreadFD=%d, writeFD=%dz should be an int�fdmap�helpers)r� T)r; )r ra r+ �pipes�debug�print�items�typer� r� r r r� �proto�processReaderFactory�processWriterFactory�makeConnectionr r! r& r# )r9 r: r� r� r� r� r� r� r� r� r� r� r� r� �childFD�target�readFD�writeFD�parentFD�reader�writerr r� r r+ n s� �
�
�
� � �zProcess.__init__c C s� | j }|r
tj}|�d� |�� }t� D ] }||v rq|r$||�� kr$qzt�|� W q t y4 Y qw |r>t
d||d� t |� � �D ][}|| }||kr^|rXt
d| |d� t
�|� qD||�� v r�t�|�}|rut
d||f |d� t�|� t|�� �D ] \} }
|
|kr�||| < q�|r�t
d||f |d� t�||� qDg } |�� D ]}|| vr�||� � vr�| �|� q�|r�t
d| |d� | D ]}t�|� q�| �� dS ) a
fdmap[childFD] = parentFD
The child wants to end up with 'childFD' attached to what used to be
the parent's parentFD. As an example, a bash command run like
'command 2>&1' would correspond to an fdmap of {0:0, 1:1, 2:1}.
'command >foo.txt' would be {0:0, 1:os.open('foo.txt'), 2:2}.
This is accomplished in two steps::
1. close all file descriptors that aren't values of fdmap. This
means 0 .. maxfds (or just the open fds within that range, if
the platform supports '/proc/<pid>/fd').
2. for each childFD::
- if fdmap[childFD] == childFD, the descriptor is already in
place. Make sure the CLOEXEC flag is not set, then delete
the entry from fdmap.
- if childFD is in fdmap.values(), then the target descriptor
is busy. Use os.dup() to move it elsewhere, update all
fdmap[childFD] items that point to it, then close the
original. Then fall through to the next case.
- now fdmap[childFD] is not in fdmap.values(), and is free.
Use os.dup2() to move it to the right place, then close the
original.
zstarting _setupChild
r� r� z%d already in placezos.dup(%d) -> %dzos.dup2(%d,%d)�oldN)� debug_childr� r� rH r r� r3 r r� r r� �sorted�keysr �_unsetCloseOnExec�dupr r� �dup2�appendr� ) r9 r� r� �errfd�destListr/ �childr� � newtarget�c�pr� r r r r� � s\
�
�
� zProcess._setupChildc C s | j | �|� d S rF �r� rH �r9 r� rC r r r � writeToChildE r[ zProcess.writeToChildc C s || j v r| j | �� d S d S rF )r� r_ )r9 r� r r r � closeChildFDH s
�zProcess.closeChildFDc C �& | j �� D ] }t|t�r|�� qd S rF )r� r �
isinstancerV rG �r9 r� r r r �pauseProducingP �
��zProcess.pauseProducingc C r� rF )r� r r rV r8 r r r r �resumeProducingU r zProcess.resumeProducingc C s | � d� dS )zD
Call this to close standard input on this process.
r N�r� r> r r r �
closeStdin[ � zProcess.closeStdinc C � | � d� d S rz r r> r r r � closeStdouta � zProcess.closeStdoutc C r �Nr� r r> r r r � closeStderrd r
zProcess.closeStderrc C s | � � | �� | �� d S rF )r r r r> r r r r_ g s zProcess.loseConnectionc C �" d| j v r| j d �|� dS dS �z�
Call this to write to standard input on this process.
NOTE: This will silently lose data if there is no standard input.
r Nr� rI r r r rH l �
�z
Process.writec C s, d| j v r| j d �||� dS |�� dS )z�
Call this to register producer for standard input.
If there is no standard input producer.stopProducing() will
be called immediately.
r N)r� �registerProducer�
stopProducing)r9 �producer� streamingr r r r u s
zProcess.registerProducerc C s d| j v r| j d �� dS dS )z=
Call this to unregister producer for standard input.r N)r� �unregisterProducerr> r r r r � s
�zProcess.unregisterProducerc C r
r )r� �
writeSequence)r9 �seqr r r r � r zProcess.writeSequencec C s | j �||� d S rF �r� rZ )r9 r. rC r r r rZ � s zProcess.childDataReceivedc C sT t �| j| �� � | j|= z| j�|� W n
ty# t�� Y nw | � � d S rF )
r r� r� r3 r� rM r r r! �maybeCallProcessEnded)r9 r� rO r r r rM � s � zProcess.childConnectionLostc C s* | j rd S | js| �� d S t�| � d S rF )r� � lostProcessr ra r r> r r r r � s z Process.maybeCallProcessEndedc C r� rF r� r> r r r �getHost� � zProcess.getHostc C r� rF r� r> r r r �getPeer� r zProcess.getPeer�NNN) rP rQ rR rS r� r� r% r# r( r� rV r� r+ r� r� r� r r r r r r_ rH r r r rZ rM r r r r r r r r� V s<
�w`
r� c @ s� e Zd ZdZdZdZ d dd�Zdd� Zdd � Zd
d � Z d d
� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd� Zdd� ZdS ) �
PTYProcessz<
An operating-system Process that uses PTY support.
r� Nc
C s t du rt| ttf�std��tj�| |� t�| |� t| ttf�r)| \}
} } nt � � \}
} z| j
|||||||
| d� W n t yW t| ttf�sVt �
|
� t �
| � � w t �
| � t�|
� |
| _| �� d| _d| _z| j�| � W n
t y� t�� Y nw t| j| � dS )r� Nz:cannot use PTYProcess on platforms without the pty module.)�masterfd�slavefdr) r� )�ptyr �tupler r� r r* r+ ra �openptyr� r r r� r r, r/ r8 rT r% r� r� r r! r& r# )
r9 r: r� r� r� r� r� r� r� �usePTYr r �_r r r r+ � sL �
�
�
�zPTYProcess.__init__c C s� t �|� t �� t�|tjd� td�D ] }||kr t �|� qt �|d� t �|d� t �|d� t � D ]}|dkrMzt �|� W q6 t
yL Y q6w q6| � � dS )a9
Set up child process after C{fork()} but before C{exec()}.
This involves:
- closing C{masterfd}, since it is not used in the subprocess
- creating a new session with C{os.setsid}
- changing the controlling terminal of the process (and the new
session) to point at C{slavefd}
- duplicating C{slavefd} to standard input, output, and error
- closing all other open file descriptors (according to
L{_listOpenFDs})
- re-setting all signal handlers to C{SIG_DFL}
@param masterfd: The master end of a PTY file descriptors opened with
C{openpty}.
@type masterfd: L{int}
@param slavefd: The slave end of a PTY opened with C{openpty}.
@type slavefd: L{int}
� r� r r) r� N) r r� �setsid�fcntl�ioctl�termios� TIOCSCTTYr{ r� r� r r� )r9 r r r/ r r r r� s&
�
�� zPTYProcess._setupChildc C � d S rF r r> r r r r 0 s zPTYProcess.closeStdinc C r, rF r r> r r r r 5 � zPTYProcess.closeStdoutc C r, rF r r> r r r r 8 r- zPTYProcess.closeStderrc s t �� j� fdd��S )zM
Called when my standard output stream is ready for reading.
c s � j �d| �S rz r )rC r> r r �<lambda>@ s z#PTYProcess.doRead.<locals>.<lambda>)r rX r/ r> r r> r rJ ; s �zPTYProcess.doReadc C r< )zR
This returns the file number of standard output on this process.
r= r> r r r r3 C r? zPTYProcess.filenoc C s | j dkr t�| � d S d S r )r ra r r> r r r r I s
�z PTYProcess.maybeCallProcessEndedc C s4 t j�| |� t�| j� | jd7 _| �� dS )zU
I call this to clean up when one or all of my connections has died.
r) N)r r* rL r r� r/ r r rN r r r rL S s zPTYProcess.connectionLostc C s t �| j|�S r@ )r rA r/ rI r r r rE \ r zPTYProcess.writeSomeDatac C r� rF r� )r9 �
descriptorr r r r� b r zPTYProcess.closeChildFDc C r� rF r� r� r r r r� f r zPTYProcess.writeToChildr )rP rQ rR rS r% r# r+ r� r r r rJ r3 r rL rE r� r� r r r r r � s&
�C0
r )8rS rb r� r� r rt r0 r� r� �typingr r r �zope.interfacer �twisted.internetr r r � twisted.internet._baseprocessr �twisted.internet.interfacesr
�twisted.internet.mainr r �twisted.pythonr
r �twisted.python.runtimer �twisted.python.utilr � isWindowsr� r! �_ptyr( �_fcntlr* ru r r� r� r r& r' r* r( rV ra r� r� r� r� r r r r r �<module> sj � � �
h< Rj _