i dZddlmZddlZddlZddlZddlZddlZddlZddl m Z ddl m Z ddl mZddl mZddl mZdd l mZdd l mZdd l mZdd l mZdd l mZGddeZGddeZGddeZGddeZGddejZGddeZGddeZGddeZGdd eZd|d$Z Gd%d&Z!Gd'd(Z"e#e$fZ%ej&'d)Z(ej)Z*e(d*krd}d.Z+nKe(rDddlZddl,Z,ej-.e,j/d/e*zZ0e1e0d0Z2d}d1Z+nd2xZ3Z+Gd3d4Z4Gd5d6Z5Gd7d8e6Z7ej8e%fd~d>Z9Gd?d@e6Z:GdAdBe;Z<e=Z>GdCdDZ?e=Z@dEZAdFZBGdGdHZCGdIdJZDGdKdLeDZEGdMdNeDZFGdOdPZGGdQdReGZHGdSdTe6ZIGdUdVeIZJGdWdXeIZKdd\ZLeLd]ZMd^ZNd_ZOejPeOZQd`ZRejPeRZSGdadbe6ZTGdcddZUGdedfZVddhZWddiZX dddpZY dddrZZ ddduZ[ddvZ\GdwdxZ]ddzZ^dd{Z_dS)zBase execnet gateway code send to the other side for bootstrapping. :copyright: 2004-2015 :authors: - Holger Krekel - Armin Rigo - Benjamin Peterson - Ronny Pfannschmidt - many others ) annotationsN)interrupt_main)BytesIO)Any)Callable)Iterator)Literal) MutableSet)Protocol)cast)overloadceZdZddZdS)WriteIOdatabytesreturnNonecdSNselfrs [/home/ubuntu/.hermes/hermes-agent/venv/lib/python3.11/site-packages/execnet/gateway_base.pywritez WriteIO.write!Nrrrr)__name__ __module__ __qualname__rrrrrr s000000rrceZdZddZdS)ReadIOnumbytesintrrcdSrrrr#s rreadz ReadIO.read%rrNr#r$rr)rrr r'rrrr"r"$s222222rr"cJeZdZUded<ddZdd Zdd Zdd ZddZddZ dS)IO ExecModel execmodelr#r$rrcdSrrr&s rr'zIO.read+rrrrcdSrrrs rrzIO.write-rrcdSrrrs r close_readz IO.close_read/rrcdSrrr0s r close_writezIO.close_write1rr int | NonecdSrrr0s rwaitzIO.wait3rrcdSrrr0s rkillzIO.kill5rrNr(rrr)rr4) rrr __annotations__r'rr1r3r6r8rrrr*r*(sf22220000%%%%&&&&%%%%rr*c4eZdZdZd dZd dZd dZddd ZdS)Eventz3Protocol for types which look like threading.Event.rboolcdSrrr0s ris_setz Event.is_set;rrrcdSrrr0s rsetz Event.set=rrcdSrrr0s rclearz Event.clear?rrNtimeout float | NonecdSrrrrDs rr6z Event.waitArrrr=r9rrDrErr=)rrr __doc__r?rArCr6rrrr<r<8sI==!!!!    =======rr<ceZdZeejddZddZeejdZeejdZ eejdZ ejddd Z ejdd Z ejddZ ejddZejdZejdZejddZdS)r+rstrctrNotImplementedErrorr0s rbackendzExecModel.backendE"###rcd|jzS)NzrPr0s r__repr__zExecModel.__repr__Js$,..rctrrNr0s rqueuezExecModel.queueMrQrctrrNr0s r subprocesszExecModel.subprocessRrQrctrrNr0s rsocketzExecModel.socketWrQrrrctrrN)rfuncargss rstartzExecModel.start\!###rr$ctrrNr0s r get_identzExecModel.get_ident`r_rdelayfloatctrrN)rrbs rsleepzExecModel.sleepdr_rTctrrN)rfdmodebufsizeclosefds rfdopenzExecModel.fdopenhr_rctrrNr0s rLockzExecModel.Locklr_rctrrNr0s rRLockzExecModel.RLockpr_rr<ctrrNr0s rr<zExecModel.Eventtr_rNrrLrr9rr$rbrcrrrfT)rr<)rrr propertyabcabstractmethodrPrTrVrXrZr^rarerlrnrpr<rrrr+r+Ds $$$X$////$$X$$$X$$$X$ $$$$$ $$$$ $$$$ $$$$ $$$ $$$ $$$$$$rr+) metaclassceZdZdZedZedZedZddZdd Z ddd Z ddZ dZ dZ dZdS)ThreadExecModelthreadcddl}|SNr)rV)rrVs rrVzThreadExecModel.queue|s  rcddl}|Sr)rX)rrXs rrXzThreadExecModel.subprocesssrcddl}|Sr)rZ)rrZs rrZzThreadExecModel.sockets  rrr$c2ddl}|Sr)_threadra)rrs rrazThreadExecModel.get_idents  """rrbrcrc8ddl}||dSr)timere)rrbrs rrezThreadExecModel.sleeps#  5rrc:ddl}|||dSr)rstart_new_thread)rr\r]rs rr^zThreadExecModel.starts'  t,,,,,rrfTc4ddl}|j|||d|S)Nrutf-8)encodingrk)osrl)rrhrirjrkrs rrlzThreadExecModel.fdopens( ryT7WgNNNNrc2ddl}|Sr threadingrprrs rrnzThreadExecModel.Lock   rc2ddl}|Srrrs rrpzThreadExecModel.RLockrrc2ddl}|Sr)rr<rs rr<zThreadExecModel.EventrrNrtrursr9rvrrr rPrwrVrXrZrarer^rlrnrpr<rrrr|r|ysG X X X ####  ----- OOOO !!! !!! !!!!!rr|ceZdZdZdS)MainThreadOnlyExecModelmain_thread_onlyN)rrr rPrrrrrs GGGrrceZdZdZedZedZedZddZdd Z ddd Z ddZ dZ dZ dZdS)EventletExecModeleventletcddl}|jSr)rrVrrs rrVzEventletExecModel.queues~rc"ddl}|jjSr)eventlet.green.subprocessgreenrXrs rrXzEventletExecModel.subprocesss((((~((rc"ddl}|jjSr)eventlet.green.socketrrZrs rrZzEventletExecModel.sockets$$$$~$$rrr$cFddl}|jjSr)eventlet.green.threadrr}rars rrazEventletExecModel.get_idents%$$$$~$..000rrbrcrc8ddl}||dSr)rre)rrbrs rrezEventletExecModel.sleeps#urrc*ddl}|j|g|RdSr)rspawn_n)rr\r]rs rr^zEventletExecModel.starts,%%%%%%%rrfTcPddl}|jj||||SNrrk)eventlet.green.osrrrl)rrhrirjrkrs rrlzEventletExecModel.fdopens0    ~ ''D'7'KKKrcFddl}|jjSreventlet.green.threadingrrrprs rrnzEventletExecModel.Lock%''''~'--///rcFddl}|jjSrrrs rrpzEventletExecModel.RLockrrcFddl}|jjSr)rrrr<rs rr<zEventletExecModel.EventrrNrtrursr9rvrrrrrrsG X ))X) %%X% 1111  &&&&& LLLL 000 000 00000rrceZdZdZedZedZedZddZdd Z ddd Z ddZ dZ dZ dZdS)GeventExecModelgeventcddl}|jSr) gevent.queuerVrrs rrVzGeventExecModel.queues|rcddl}|jSr)gevent.subprocessrXrs rrXzGeventExecModel.subprocesss      rcddl}|jSr)rrZrs rrZzGeventExecModel.sockets }rrr$c<ddl}|jSr) gevent.threadr}rars rrazGeventExecModel.get_idents"}&&(((rrbrcrc8ddl}||dSr)rre)rrbrs rrezGeventExecModel.sleep s#  Urrc*ddl}|j|g|RdSr)rspawn)rr\r]rs rr^zGeventExecModel.starts+  T!D!!!!!!rrfTcFddl}|j||||Sr)gevent.fileobject fileobjectFileObjectThread)rrhrirjrkrs rrlzGeventExecModel.fdopens.     11"dGW1UUUrc<ddl}|jSr gevent.locklockrprs rrnzGeventExecModel.Lock"{  """rc<ddl}|jSrrrs rrpzGeventExecModel.RLockrrc<ddl}|jSr) gevent.eventeventr<rs rr<zGeventExecModel.Event#s"|!!###rNrtrursr9rvrrrrrrsG X !!X! X ))))  """"" VVVV ### ### $$$$$rrrPstr | ExecModelrct|tr|S|dkrtS|dkrtS|dkrt S|dkrt St d|)Nr}rrrzunknown execmodel ) isinstancer+r|rrr ValueErrorrSs r get_execmodelr)s'9%%(   & & &&((( J   """ H     9g99:::rc6eZdZdZd dZddd Zddd Zdd ZdS)ReplyzhProvide access to the result of a function execution that got dispatched through WorkerPool.spawn(). threadmodelr+rrcT||_||_d|_dSNT)taskr< _result_readyrunning)rrrs r__init__zReply.__init__<s( (..00 rNrDrEch|| |jS#t$r |jdwxYw)zget the result object from an asynchronous function execution. if the function execution raised an exception, then calling get() will reraise that exception including its traceback. N) waitfinish_resultAttributeError_excrGs rgetz Reply.getAsH     &<  & & &) % &s1ch|j|std|jdS)Nztimeout waiting for )rr6OSErrorrrGs rrzReply.waitfinishMsA!&&w// @>>>?? ? @ @rc|j\}}} ||i||_n#t$r}||_Yd}~nd}~wwxYw|jd|_dS#|jd|_wxYwNF)rr BaseExceptionrrrAr)rr\r]kwargsexcs rrunz Reply.runQs!YdF ! #tT4V44          " " $ $ $ DLLL   " " $ $ $ DL s% A 72A7A"A>)rr+rrr)rDrErDrErrr9)rrr rJrrrrrrrrr8s}## & & & & &@@@@@ ! ! ! ! ! !rrcleZdZUdZded<ddd Zdd Zdd ZddZddZ ddZ d dZ d!d"dZ d!d"dZ dS)# WorkerPoolaA WorkerPool allows to spawn function executions to threads, returning a reply object on which you can ask for the result (and get exceptions reraised). This implementation allows the main thread to integrate itself into performing function execution through calling integrate_as_primary_thread() which will return when the pool received a trigger_shutdown(). By default allows unlimited number of spawns. z Reply | None_primary_thread_taskFr,r+ hasprimaryr=rrc||_|j|_t|_d|_g|_|r=|jjdvrtd|j |_ dSd|_ dS)NFr}rz%hasprimary=True requires thread model) r,rn _running_lockrA_running _shuttingdown_waitall_eventsrPrr<_primary_thread_task_ready)rr,rs rrzWorkerPool.__init__ls"!^0022+.55 ",.  3~%-KKK !HIII<@N$>M!%%'''*( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( (sABB  B c|j}|~|s||_|dS|jjdkr=|j6|j||_|dSdS)NTrF)rr?rrAr,rPr)rrrs r_try_send_to_primary_threadz&WorkerPool._try_send_to_primary_threads%)$C! $ 0,3355 ,1))--///t&*<<<-9)44666,1) *--///turc@t|||f|j}|j5|jrt d|j|||s!|j|j |fdddn #1swxYwY|S)zAAsynchronously dispatch func(*args, **kwargs) and return a Reply.zpool is shutting downN) rr,rrrraddrr^r)rr\r]rrs rrzWorkerPool.spawnstT6*DN;;   D D! : !8999 M  e $ $ $33E:: D$$T%85(CCC  D D D D D D D D D D D D D D D  sA'BBBNrDrEcV|||S)z;Trigger shutdown and wait for completion of all executions.rD)rwaitallrGs r terminatezWorkerPool.terminates( ||G|,,,rc|j5|js ddddS|j}|j|dddn #1swxYwY||S)z5Wait until all active spawns have finished executing.NTr)rrr,r<rappendr6)rrDmy_waitall_events rrzWorkerPool.waitalls   : :=  : : : : : : : : $~3355   ' '(8 9 9 9 : : : : : : : : : : : : : : : $$W$555s A3AA!$A!F)r,r+rr=rrr9rt)rrrr)rrrr=)rrrrI)rrr rJr:rrrrrrrrrrrrrr]s  '&&& 3 3 3 3 36666.6666""""((((2    ----- 6 6 6 6 6 6 6rr EXECNET_DEBUG2msgobjectrc  dtt|}tjdt d|dtjdS#t$rYdSwxYw)N [z]  ) joinmaprLsysstderrrpidflush Exception)rlines rtracers 88CSMM**D J  000000 1 1 1 J           DD sA1A55 BBzexecnet-debug-%dwcz dtt|}t|dztdS#t $rN} tjdtd|dn#t $rYn wxYwYd}~dSYd}~dSd}~wwxYw)Nrrrz] exception during tracing: ) rrrL debugfilerrrrrr)rrrs rrrs 88CSMM**D OOD4K ( ( ( OO            !OS!O!Oc!O!O!OPPPP    QPPPPP  s6AA"" B:-+BB5 B&#B5%B&&B55B:cdSrr)rs rr"s4rc@eZdZeeefZddZdd Zdd Z dd Z dd Z dS)Popen2IOr,r+rrc||c|_|_tjdkrddl} ||tj||tjn#ttf$rYnwxYwt|d|j |_ t|d|j|_||_dS)Nwin32rbuffer)outfileinfilerplatformmsvcrtsetmodefilenorO_BINARYrrgetattrr'_readr_writer,)rr(r)r,r+s rrzPopen2IO.__init__s$+V! dk <7 " " MMM v}} <<<w~~//===="G,    VXv66; gx99? "sA$B BBr#r$rcd}|t|kr`||t|z }|s!td|t|fz||z }|t|k`|S)z,Read exactly 'numbytes' bytes from the pipe.rzexpected %d bytes, got %d)rr0EOFError)rr#bufrs rr'z Popen2IO.readsS!!::hS122D S:hC=QQRRR 4KC S!!  rrct|tsJ|||jdS)zWrite out all data bytes.N)rrr1r(rrs rrzPopen2IO.writesD$&&&&& D rc8|jdSr)r)closer0s rr1zPopen2IO.close_read"s rc8|jdSr)r(r7r0s rr3zPopen2IO.close_write%s rN)r,r+rrr(rr9) rrr IOErrorrr3errorrr'rr1r3rrrr$r$s gx (E # # # #     rr$c,eZdZUdZiZded<d1d2d Zed3dZd4dZ d5dZ d6dZ d7dZ dZ de fee <d7dZdZdefee<d7dZdZd efee<d7d!Zd"Zd#efee<d7d$Zd%Zd&efee<d7d'Zd(Zd)efee<d7d*Zd+Zd,efee<d7d-Zd.Zd/efee<d0S)8Messagez.Encapsulates Messages and their wire protocol.z=dict[int, tuple[str, Callable[[Message, BaseGateway], None]]]_typesrrmsgcoder$ channelidrrrrc0||_||_||_dSr)r>r?r)rr>r?rs rrzMessage.__init__/s " rior"c, |d}|stdn0#t$r#}td|jdzdd}~wwxYwtjd|\}}}t ||||S)N z empty readzcouldn't load message header, r!bii)r'r3r]structunpackr<)rAheaderemsgtypechannelpayloads rfrom_iozMessage.from_io4s SWWQZZF -|,,, - S S S;afQiGHHd R S$*M&&$A$A!'w)9)9:::s&) AAArctjd|j|jt |j}|||jzdS)NrD)rEpackr>r?rrr)rrArGs rto_ioz Message.to_io?sBVT\4>3ty>>RR $)#$$$$$rgateway BaseGatewaycN|j|jd}|||dS)Nrf)r=r>)rrPhandlers rreceivedzMessage.receivedCs-+dl+A.grrLcx|j|jd}d|d|jdt|jdS)Nrz )r=r>r?rr)rnames rrTzMessage.__repr__Gs@{4<(+T4TT$.TT3ty>>TTTTrmessagec2t|jj|j|jjd}|tj |j t||tj |j dS)N) numchannels numexecutingr,) r_channelfactory _channels _execpoolrr,rP_sendr< CHANNEL_DATAr?dumps_internal CHANNEL_CLOSE)rXrPds r_statuszMessage._statusKsw6@AA#-::<< *2     g*G,=~a?P?PQQQ g+W->?????rSTATUSct|j|}t|tsJ|}|jdkr ||_dS||j|j_dSr)loads_internalrrtupler? _strconfigr\new)rXrPr strconfigs r _reconfigurezMessage._reconfigureZslglG44$&&&&&'+   ! !!*G   HQG # ' '(9 : : E E Errf RECONFIGUREc t|r)GatewayReceivedTerminaterXrPs r_gateway_terminatezMessage._gateway_terminatefs&w///rGATEWAY_TERMINATEc||j|j}|||jdS)N)rJ sourcetask)r\rjr?_local_schedulexecr)rXrPrJs r _channel_execzMessage._channel_execls<)--g.?@@""7w|"LLLLLr CHANNEL_EXECcP|j|j|jdSr)r\_local_receiver?rrps r _channel_datazMessage._channel_datass&..w/@',OOOOOrr`cD|j|jdSrr\ _local_closer?rps r_channel_closezMessage._channel_closeys",,W->?????rrbct|j}t|tsJt |}|j|j|dSr)rgrrrL RemoteErrorr\rr?)rXrP error_message remote_errors r_channel_close_errorzMessage._channel_close_errorsV&w|44 ------"=11 ,,W-> MMMMMrCHANNEL_CLOSE_ERRORcH|j|jddSNT)sendonlyrrps r_channel_last_messagezMessage._channel_last_messages',,W->,NNNNNrCHANNEL_LAST_MESSAGENrrr>r$r?r$rrrr)rAr"rr<)rArrr)rPrQrrrr)rXr<rPrQrr)rrr rJr=r:r staticmethodrLrOrTrTrdrerlrmrqrsrwryr|r`rrbrrrrrrrr<r<)s88MOFNNNN ;;;\;%%%%UUUU @ @ @ @F(F6NRRRRK(,7F;0000!46H IF MMMML*M:F<PPPPL*M:F<@@@@M,n=F=NNNN #8:N"OF OOOO$: ? ?GGAJJ  333Cyy)22S22 3 s47(A"!A"c<eZdZdZd fd Zd dZd dZd d ZxZS) rz=Exception containing a stringified error from the other side. formattedrLrrcVt||_dSr)superrr)rr __class__s rrzRemoteError.__init__s$ "rc|jSr)rr0s r__str__zRemoteError.__str__s ~rc.|jjd|jS)Nr)rrrr0s rrTzRemoteError.__repr__s.)==T^===rc|jtkr9tjdt jd|ddSdS)Nrz] Warning: unhandled r)rINTERRUPT_TEXTrrrrgetpidr0s rwarnzRemoteError.warnsM >^ + + J  MMM4MMM N N N N N , +r)rrLrrrrr9) rrr rJrrrTr __classcell__rs@rrrsGG######>>>>OOOOOOOOrrceZdZdZdS) TimeoutErrorz0Exception indicating that a timeout was reached.Nrrrrrrs::::rrceZdZdZeZeZdZdZd5d Zd6d Z e fd7dZ d8dZ d9dZ dZd:dZed;dd Z d?d@d$ZdAd9d&ZdAdBd)ZdCd+ZdAdDd-ZdEd/ZdFd0ZeZ dGdHd4Zd%S)IChannelzFCommunication channel between two Python Interpreter execution points.iFrPrQidr$rrc\t|tsJt|trJ||_t |dd|_||_|jjj |_ d|_ |jj |_ g|_dS)z :private:riTFFN)rr$rrPr/rirr,rVQueue_items_closedr<_receiveclosed _remoteerrors)rrPrs rrzChannel.__init__s"c"""""gt,,,,, !'<GGl,288::  "l4::<<02rrrc6|jj|jg|RdSr)rP_tracerrrs rrzChannel._traces' DG*c******rcallbackCallable[[Any], Any] endmarkerc|jjj}|jj5|jt |d|j}d|_ |d}|tur*|||tur ||n^||nQ#|jj j j $r5|j s+|js|||jf||j<YnwxYwddddS#1swxYwYdS)aSet a callback function for receiving items. All already-queued items will immediately trigger the callback. Afterwards the callback will execute in the receiver thread for each received data item and calls to ``receive()`` will raise an error. If an endmarker is specified the callback will eventually be called with the endmarker when the channel closes. Nz has callback already registeredrfF)block)rPr\ _callbacks _receivelockrrr ENDMARKERputNO_ENDMARKER_WANTEDr,rVEmptyrrr?rir)rrrritemsolditems r setcallbackzChannel.setcallbacks\1< \ & * *{"IIIJJJKEDK * *#iiei44G )++ '***$,???$HY/// ))))|-39 LUD,?,F,F,H,HU/7DO.T 47+E *  * * * * * * * * * * * * * * * * * *s6)C<B?C<A C+(C<*C++C<<DDrLcJ|rdpd}d|j|fzS)Nclosedopenz)isclosedr)rflags rrTzChannel.__repr__s* ,H7#two55rc|jdS|d|jr |jD]}|dS|jrdSt[|j tj }n tj } |j ||j dS#ttf$rYdSwxYwdS)Nzchannel.__del__)rPrrrrrr?r<rrrbr_rrr)rr:r>s r__del__zChannel.__del__s <  F %&&& < +       ' ' ) )  D";&%:GG%3GL&&w88888,DD#"s B++C?Cc |jdS#t$r# |jjcYS#t $rYnwxYwYdSwxYwr)rr IndexErrorrP_errorrr0s r_getremoteerrorzChannel._getremoteerrorsv %))!,, ,    |****!    44  s. A  5A  AA AA A r=c|jS)z^Return True if the channel is closed. A closed channel may still hold items. )rr0s rrzChannel.isclosed)s |r.ri Literal['r'] proxycloseChannelFileReadcdSrrrrirs rmakefilezChannel.makefile0s r Literal['w']ChannelFileWritecdSrrrs rrzChannel.makefile4s rrLiteral['r', 'w']"ChannelFileWrite | ChannelFileReadc|dkrt||S|dkrt||Std|d)zReturn a file-like object. mode can be 'w' or 'r' for writeable/readable files. If proxyclose is true, file.close() will also close the channel. r)rJrrzmode z not available)rrrrs rrzChannel.makefile<sV 3;;#DZHHH H S[["4JGGG G7777888rNc|jrtd|jr|j|d|js|jsh|jj}|*|tj |j t|n|tj |j |dt|tr|j|d|_|j|j}||t(|jj|j dSdS)zClose down this channel with an optional error message. Note that closing of a channel tied to remote_exec happens automatically at the end of execution and cannot be done explicitly. z2cannot explicitly close channel within remote_execz"ignoring redundant call to close()Nzsent channel close messageT) _executingrrrPrrr?r_r<rrrarbrrrr rArrrr\_no_longer_opened)rr:rrVs rr7z Channel.closeLsU ? PNOO O < L L  &J K K K| D &--// :l($C3TWnU>S>STTTTC-tw777 8999%-- 1"))%000DL   # # % % %KE  )$$$ L ( : :47 C C C C C) D DrrDrEc|j||js|d|z|}|r|dS)a^Wait until this channel is closed (or the remote side otherwise signalled that no more data was being sent). The channel may still hold receiveable items, but not receive any more after waitclose() has returned. Exceptions from executing code on the other side are reraised as local channel.RemoteErrors. EOFError is raised if the reading-connection was prematurely closed, which often indicates a dying process. self.TimeoutError is raised after the specified number of seconds (default is None, i.e. wait indefinitely). rzTimeout after %r secondsN)rr6r?rr)rrDr:s r waitclosezChannel.waitclosemsx"    111"))++ J##$>$HII I$$&&  K  ritemc|rtd||jtj|jt|dS)a!Sends the given item to the other side of the channel, possibly blocking if the sender queue is full. The item must be a simple Python type and will be copied to the other side by value. OSError is raised if the write pipe was prematurely closed. zcannot send to N)rrrPr_r<r`rra)rrs rsendz Channel.sendsX ==?? 64D4455 5 7/.:N:NOOOOOrrcR|j}|td ||}n6#|jjjj$r|d|zdwxYw|tur7| || p t|S)aReceive a data item that was sent from the other side. timeout: None [default] blocked waiting. A positive number indicates the number of seconds after which a channel.TimeoutError exception will be raised if no item was received. Note that exceptions from the remotely executing code will be reraised as channel.RemoteError exceptions containing a textual representation of the remote traceback. Nz/cannot receive(), channel has receiver callbackrzno item after %r seconds) rrrrPr,rVrrrrrr3)rrD itemqueuexs rreceivezChannel.receivesK  KLL L T g ..AA|%+1 T T T##$>$HIIt S T >> MM!   &&((6HJJ 6Hs 13A$ Iterator[Any]c|Srrr0s r__iter__zChannel.__iter__s rcX |S#t$r tdwxYwr)rr3 StopIterationr0s rnextz Channel.nexts8 *<<>> ! * * *T ) *s)Tpy2str_as_py3strpy3str_as_py2strc||f|_t|j}|jtj|j|dS)zSet the string coercion for this channel. The default is to try to convert py2 str as py3 str, but not to try and convert py3 str to py2 str )rN)rirarPr_r<rmr)rrrrs r reconfigurezChannel.reconfiguresH,-=>do.. 7.dCCCCCr)rPrQrr$rrrrrr)rrrrrrrrr9rH).)rirrr=rr)..)rirrr=rr)rF)rirrr=rrrr)rrrr)rDrErr)rr)rrr)rr=rr=rr)rrr rJrr_INTERNALWAKEUPrrrrrrTrrrr rr7rrrrr__next__rrrrrrsPPKLOJ 3 3 3 3++++ 0"*"*"*"*"*H6666<    X !    X #& 99999 DDDDDB0 P P P P0**** HGL D D D D D D Drrzkeyboard-interruptedzJconcurrent remote_exec would cause deadlock for main_thread_only execmodelcLeZdZdddZddd ZddZddZdddZddZddZ d S) ChannelFactoryrfrPrQ startcountr$rrctj|_i|_|j|_||_||_d|_ t|_ dSr) weakrefWeakValueDictionaryr]rr,rn _writelockrPcountfinishedlist_list)rrPrs rrzChannelFactory.__init__sY  ' ) )   "+0022    rNrr4rc2|j5|jrtd|j||j}|xjdz c_ |j|}n/#t $r"t|j|x}|j|<YnwxYw|cdddS#1swxYwYdS)z:Create a new Channel with 'id' (or create new id if None).zconnection already closed: Nrr)rrrrPrr]KeyErrorr)rrrJs rrjzChannelFactory.news _  } LJDLJJKKKzZ a  I., I I I/6t|R/H/HH$.,,, I                  s58B  AB )A;8B :A;;B  BB list[Channel]cZ||jSr)rr]valuesr0s rchannelszChannelFactory.channelss"zz$.//11222rc |j|=n#t$rYnwxYw |j|\}}}|tur ||dSdS#t$rYdSwxYwr)r]r rrr)rrrrris rrz ChannelFactory._no_longer_openeds r""    D  $.2o.A.A".E.E +Hi 333#####43    DD s A A A Frr=c|j|}|-|r|||dS|r|j||j}||t|||sd|_ |j dSr) r]rrrrr rrrrrrA)rr remoteerrorrrJrVs rrzChannelFactory._local_closes.$$R(( ? #  """  " "2 & & & & & :%,,[999NE  )$$$  " "2 & & & '"&  " & & ( ( ( ( (rcT|j|} |j|\}}} t|||}||dS#t$r}|jd|z|j|}|jtj |t|| ||Yd}~dSd}~wwxYw#t$r9||jnd} | YdSt||} | | YdSwxYw)Nzexception during callback: %s)r]rrrgrrPr _geterrortextr_r<rrarr rr) rrrrJr _endmarkerrkrrrVrs rr{zChannelFactory._local_receive sY.$$R(( 1.2ob.A +Hj) 1%dGY?? 1 1 1 ##$Cc$IJJJ L66s;;  ""/^I5N5N!!"i000000000  1   &-&9GNNtE}%dG44 $  s/C$A C!BCC!$D'>%D'&D'c|j5d|_dddn #1swxYwY||jD]}||d||jD]}||dSr)rrrr]rrr)rrs r_finished_receivingz"ChannelFactory._finished_receiving$s _ ! ! DM ! ! ! ! ! ! ! ! ! ! ! ! ! ! !**T^,, 1 1B   b4  0 0 0 0**T_-- ' 'B  " "2 & & & & ' 's   )rf)rPrQrr$rrr)rr4rr)rr )rr$rrr)rr$rr=rrr9) rrr rrjr rrr{rrrrrrs          3333 $ $ $ $)))))&11110''''''rrc0eZdZdddZdd Zdd Zdd Zd S) ChannelFileTrJrrr=rrc"||_||_dSr)rJ _proxyclose)rrJrs rrzChannelFile.__init__.s %rcdSrrr0s risattyzChannelFile.isatty2surcJ|jr|jdSdSr)rrJr7r0s rr7zChannelFile.close5s1   ! L    ! !rrLc^|jrdpd}d|jj|fzS)Nrrz)rJrr)rstates rrTzChannelFile.__repr__9s3&&((5X@&$ '???rNTrJrrr=rrrHr9rr)rrr rrr7rTrrrrr-so&&&&&!!!!@@@@@@rrceZdZddZd dZdS) routrrrc:|j|dSr)rJr)rr"s rrzChannelFileWrite.write?s #rcdSrrr0s rrzChannelFileWrite.flushB rN)r"rrrr9)rrr rrrrrrr>s<      rrc2eZdZddfd Zdd Zdd ZxZS)rTrJrrr=rrcZt||d|_dSr)rr_buffer)rrJrrs rrzChannelFileRead.__init__Gs( *---#' rnr$rLc |j1tt|j|_t |j|krR|xjtt|jz c_t |j|kRn$#t $r|YnwxYw|jd}n#|jd|}|j|d|_|S)Nr)r(r rLrJrrr3r7)rr)rets rr'zChannelFileRead.readKs |##C)=)=)?)?@@ dl##a'' S$,*>*>*@*@ A AA dl##a''    JJLLLLL  < CC,rr"C<+DL sB"B%%CCcv|jc|jd}|dkr||dzS|t|jdz}n|d}|r7|ddkr+|d}|sn||z }|r |ddk+|S)Nrrf)r(findr'r)rircs rreadlinezChannelFileRead.readlineZs < # !!$''ABwwyyQ'''99S..233DD99Q<rrrAr* _startcountr$rrc<|j|_||_||_tjtjf|_t|||_|j |_ t|_ t|_t|j|_dSr)r,_ior Unserializerrrrirr\rprr_BaseGateway__tracerrr _receivepool)rrArr3s rrzBaseGateway.__init__nsz'8,:WX-dK@@ N0022 )&t~66rrrc,|j|jg|RdSr)r7rrs rrzBaseGateway._tracezs$ TW#s######rcD|j|jdSr)r8r_thread_receiverr0s r _initreceivezBaseGateway._initreceive}s"  566666rc(dfd }|dj} t|}|d|j5|~dddn #1swxYwY\#t t f$rYnXt$r}|d |_Yd}~n8d}~wt$r(}| |Yd}~nd}~wwxYw|d j |d  |d j|d j|djdS)Nrrrrc$jdg|RdS)Nz[receiver-thread]rrrs rlogz)BaseGateway._thread_receiver..logs$ DK+ 2c 2 2 2 2 2 2rzRECEIVERTHREAD: starting to runrfrTz-EOF without prior gateway termination messagezfinishing receiving threadzterminating executionz closing readz closing writez#terminating our receive pseudo poolr)r5r<rLrrTKeyboardInterruptror3rrrr\r_terminate_executionr1r3r8r)rrArArrs` rr;zBaseGateway._thread_receivers@ 3 3 3 3 3 3  -... X ) oob))J$$$&LL&&&  "#;<    D    C? @ @ @DKKKKKK ) ) ) C""3'' ( ( ( ( ( ( ( ( )  ())) 00222  #$$$ !!### N  O   1222 **,,,,,sM.A8 A, A8,A00A83A04A88C  C B++ C 8CC cdSrrr0s rrCz BaseGateway._terminate_executionr%rrrr>r?rrc t|||} ||j|d|dS#tt f$r,}|d||t d|d}~wwxYw)Nsentzfailed to sendzcannot send (already closed?))r<rOr5rrr)rr>r?rrXrHs rr_zBaseGateway._sends'9d33 B MM$( # # # KK ( ( ( ( ($ B B B KK('1 5 5 59:: A Bs0AB'A==BrJrruc0|ddS)Nzexecution disallowed)r7)rrJrus rrvzBaseGateway._local_schedulexecs ,-----rc4|jS)z!Return a new independent channel.)r\rjr0s r newchannelzBaseGateway.newchannels#'')))rNrDrEcd|d|j|dS)z%Wait for receiverthread to terminate.z%waiting for receiver thread to finishN)rr8rrGs rrzBaseGateway.joins2 ;<<< !!'*****r)rr)rAr*r3r$rrrr9rrrJrrurrr)rrrr)rrr r_sysexrrrr<r;rCr_rvrIrrrrrQrQjs F B 7 7 7 7 7$$$$7777----@    BBBBB....****+++++++rrQc.eZdZddZddZdd Zdd Zd S) WorkerGatewayrJrrurrrcD|jjjdkrY|jJ|jds|t dS|jt|}|j |j ||fdS)Nrrfr) r^r,rP_executetask_completer6r7MAIN_THREAD_ONLY_DEADLOCK_TEXTrCrgr executetask)rrJru sourcetask_s rrvz WorkerGateway._local_schedulexecs > # +/A A A-999-2212==  <===  & , , . . .$Z00  T-/EFFFFFrc:|d|j|jds|dtjdkr<|dt jt jdn*t#|dt|jds-|d t j d dSdSdS) Nzshutting down execution poolg@z5execution ongoing after 5 secs, trying interrupt_mainr&zsending ourselves a SIGINTrrzcalling interrupt_main()g$@z?execution did not finish in another 10 secs, calling os._exit()rf) rr^rrrr*rr8rr_exitr0s rrCz"WorkerGateway._terminate_executions 2333 '')))~%%c**  KKO P P P|w&& 8999 Q''''+ 6777   >))$//  U     rcd fd }jjdv}tj|_d_jjdkr7j_j|d  |r$|d j|d  dS#t$r|d YdSwxYw)NrrLrrc8d|zdS)Nz[serve] r?r@s rrz"WorkerGateway.serve..traces KK S( ) ) ) ) )rr)rrzspawning receiver threadzintegrating as primary threadzjoining receiver threadz,swallowing keyboardinterrupt, serve finished)rrLrr) r,rPrr^rPr<rAr<rrrB)rrrs` rservezWorkerGateway.serves@ * * * * * *^+/MM #DNzJJJ%)" > !%7 7 7)-)=)=)?)?D &  & * * , , , ()))  B =5666::<<< E+ , , , IIKKKKK  B B B E@ A A A A A A BsAC&&C?>C?rEtuple[Channel, tuple[str, str | None, str | None, dict[str, object]]]c |\}\}}}}|dd}|d|jdt|ddd|_ t |dz|pdd }t |||r.|d |d |d d ||} | |fi|d|_|dn!#d|_|dwxYwn#t $r|tt$r} t| tsY|j j jsH|d| || } || Yd} ~ dS|dYd} ~ nd} ~ wwxYw||j|jdSdS)N__channelexec__)rJrzexecution starts[z]: 2Trz execzcalling z(**z>60)Fzexecution finishedzgot exception: z,ignoring EOFError because receiving finished)rrreprrcompiler]rBr7rrrr3rPr\rrrPrA) rrrJsource file_name call_namerloccofunctionrrs rrRzWorkerGateway.executetasks: H>B ;G;fiF.5CT"U"UC KKNGJNN4<<;LNN O O O!%G  2Vd]I,H&QQR 0KKK 6666 JKKK"9~HHW/////%*" 01111&+" 011111     MM. ) ) )  H H Hc8,, 6?KK 9# 9 9::: $ 2 23 7 7IMM),,,FFFFF KKF G G G G G G G G H    % 1  & * * , , , , , 2 1s8A C#AC$C#CC##.FA(F?FFNrKr9)rrYrr)rrr rvrCrXrRrrrrNrNslGGGG&(BBBB2#-#-#-#-#-#-rrNceZdZdS)DataFormatErrorNrrr rrrrhrh+DrrhceZdZdZdS) DumpErrorz"Error while serializing an object.Nrrrrrlrl/s,,,,rrlceZdZdZdS) LoadErrorz$Error while unserializing an object.Nrrrrrnrn3s....rrnr)r$rc"t|gSr)r)r)s rbchrrp7s !::rrriz!dz!ddceZdZdS)_StopNrirrrrrrrErjrrrcfeZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZdZdZdZdZdZdZdZdZdS)opcodez#Container for name -> num mappings.@ABCDEFGHIJKLMNOPQRSTN)rrr rJ BUILDTUPLEBYTESCHANNELFALSEFLOAT FROZENSETINTLONGLONGINTLONGLONGNEWDICTNEWLISTNONE PY2STRING PY3STRINGSETSETITEMSTOPTRUEUNICODECOMPLEXrrrrtrtIs}--J EG E EI C DGHGG DII CG D DGGGGrrtceZdZUiZded<dZdZ d-d.dZd/d0dZd1dZ e ee j <d1dZ e ee j <d1dZeee j<d1dZeee j<d1dZeee j<eZeee j<eZeee j<d1dZeee j<d1dZeee j<d2dZd3dZd1dZeee j<d1dZ e ee j!<d1d Z"e"ee j#<d1d!Z$e$ee j%<d1d"Z&e&ee j'<d1d#Z(e(ee j)<d1d$Z*e*ee j+<d4d'Z,d1d(Z-e-ee j.<d1d)Z/e/ee j0<d1d*Z1e1ee j2<d1d+Z3e3ee j4<d1d,Z5e5ee j6<dS)5r6z+dict[bytes, Callable[[Unserializer], None]]num2funcTFNstreamr"channel_or_gatewayChannel | BaseGateway | Nonerktuple[bool, bool] | Nonerrct|tr|j}n|}||j}|r|\|_|_||_| d|_dS|j|_dSr) rrrPrirrrchannelfactoryr\)rrrrkgws rrzUnserializer.__init__hsx (' 2 2 $%7%?BB#B  )*5I  E;D 8D !4#8 :"&D   "$"4D   r versionedr=rc|r7|jd}|tkrtd|zg|_ |jd}|st  |j|}n"#t$rtd|ddwxYw||`#t$rEt|jdkrtdd|j dcYSwxYw) Nrfzwrong dumpformat version %rTzunknown opcode z - wire protocol corruption?zdidn't get STOPzinternal unserialization errorr) rr'DUMPFORMAT_VERSIONrnstackr3rr rrrr)rrverrtloaders rloadzUnserializer.load|s3  E+""1%%C((( = CDDD#%  / ))!,,#"N !]62FF   #P&PPP  t   % % %4:!## @AAtK:>>!$$ $ $ $ %s+$B#' A54B#5BB##A C21C2c:|jddSrrr r0s r load_nonezUnserializer.load_none $rc:|jddSrrr0s r load_truezUnserializer.load_truerrc:|jddSrrr0s r load_falsezUnserializer.load_falses %     rcb|}|j|dSr _read_int4rr rr/s rload_intzUnserializer.load_ints- OO   !rc||}|jt|dSr)_read_byte_stringrr r$rss r load_longintzUnserializer.load_longints5  " " $ $ #a&&!!!!!rc|jt}|jt jt|ddSr)rr'FLOAT_FORMAT_SIZErr rErF FLOAT_FORMATrbinarys r load_floatzUnserializer.load_floatsE!!"344 &- f==a@AAAAArc|jt}|jt t jt|dSr) rr'COMPLEX_FORMAT_SIZErr complexrErFCOMPLEX_FORMATrs r load_complexzUnserializer.load_complexsE!!"566 '6=#H#HIJJJJJrr$cltjd|jdd}|S)N!ir}r)rErFrr')rvalues rrzUnserializer._read_int4s-]4)9)9!)<)<==a@ rrcb|}|j|}|Sr)rrr')rlengthas_bytess rrzUnserializer._read_byte_strings+"";##F++rc|}|jr|j|dS|j|ddSNr)rrrr decode)rrs rload_py3stringzUnserializer.load_py3stringsb))++   8 J  h ' ' ' ' ' J  hoog66 7 7 7 7 7rc|}|jr|d}n|}|j|dS)Nzlatin-1)rrrrr )rrrs rload_py2stringzUnserializer.load_py2stringsR))++   %__Y77AAA !rcb|}|j|dSr)rrr rs r load_byteszUnserializer.load_bytess/  " " $ $ !rc|j|ddSr)rr rrr0s r load_unicodezUnserializer.load_unicodes8 $002299'BBCCCCCrcj|}|jdg|zdSrr)rrs r load_newlistzUnserializer.load_newlists3"" 4&6/*****rct|jdkrtd|j}|j}||jd|<dS)Nrxznot enough items for setitemr-)rrrnr)rrkeys r load_setitemzUnserializer.load_setitems\ tz??Q  :;; ;   jnn# 2src:|jidSrrr0s r load_newdictzUnserializer.load_newdicts "rtype_rc|}|r@||j| d}|j| d=|j|dS|j|dSrr)rrrress r_load_collectionzUnserializer._load_collections""  '% F788,--C F788$ J  c " " " " " J  eegg & & & & &rc:|tdSr)rrhr0s rload_buildtuplezUnserializer.load_buildtuples e$$$$$rc:|tdSr)rrAr0s rload_setzUnserializer.load_set s c"""""rc:|tdSr)r frozensetr0s rload_frozensetzUnserializer.load_frozensets i(((((rctr)rrr0s r load_stopzUnserializer.load_stops rc|}|jJ|j|}|j|dSr)rrrjrr )rrrIs r load_channelzUnserializer.load_channelsR __  "...(,,R00  *%%%%%rNN)rr"rrrkrrrr )rr=rrr9rt)rr)rrrr)7rrr rr:rrrrrrtrrrrrrrrr load_longr load_longlongrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr6r6cs^<>H>>>> <@.2 55555(/////2    &HV[    &HV[!!!!(HV\$HVZ"""" ,HV^I%HV[ M -HV_BBBB(HV\KKKK ,HV^ 8888"0HV "0HV (HV\DDDD ,HV^++++ ,HV^$$$$ ,HV^ ,HV^''''%%%%#2HV ####$HVZ))))"0HV &HV[&&&& ,HV^rr6objcHt|dS)zSerialize the given obj to a bytestring. The obj and all contained objects must be of a builtin Python type (so nested dicts, sets, etc. are all OK but not user-level instances). Tr _Serializersavers rdumpsr#s! ==  cT  2 22rcZt|j|ddS)zCwrite a serialized bytestring of the given obj to the given stream.)rTrN)rrr)byteiors rdumpr-s.fl###(((=====rF bytestringrr=rrcDt|}t|||S)aXDeserialize the given bytestring to an object. py2str_as_py3str: If true then string (str) objects previously dumped on Python2 will be loaded as Python3 strings which really are text objects. py3str_as_py2str: If true then string (str) objects previously dumped on Python3 will be loaded as Python2 strings instead of unicode objects. If the bytestring was dumped with an incompatible protocol version or if the bytestring is corrupted, the ``execnet.DataFormatError`` will be raised. )rr)rr)rrrrAs rloadsr2s1   B  -@P   rrAcT||f}t||dS)z}Derserialize an object form the specified stream. Behaviour and parameters are otherwise the same as with ``loads`` )rkTr)r6r)rArrrks rrrHs3"#34I i 0 0 0 5 5 5 E EErrkrcft|}t|||Sr)rr6r)rrrkrAs rrgrgSs/   B NI 6 6 ; ; = ==rcDt|Srrrs rrara\s ==  c " ""rceZdZUiZded<dDdEdZdFdGdZdHdZdIdZdJdZ dKdZ dLdZ dLdZ dKdZ dMd!ZdNd"ZdOd$ZdPd'ZdQd*Zd+efzfdRd-ZdSd0ZdTd3ZdUd6ZdVd9ZdWd<ZdXd>ZdYd@ZdZdCZdS)[rz1dict[type, Callable[[_Serializer, object], None]] _dispatchNrCallable[[bytes], None] | Nonerrc>|g|_|jj}||_dSr) _streamlistr r1)rrs rrz_Serializer.__init__cs% =,.D $+E rFrrrr= bytes | Nonec|r|t|||tj |j}n#t $rYdSwxYwd|S)Nr)r1r_savertrr rr)rrr streamlists rrz_Serializer.saveis  , KK* + + + 3 FK    )JJ   44 xx ###sA A('A(ct|} |j|}nQ#t$rDd|jz}t |j|d}|t d|d|x}|j|<YnwxYw|||dS)Nsave_zcan't serialize )rrr rr/rrl)rrtpdispatch methodnamemeths rr z_Serializer._savews #YY 1~b)HH 1 1 1 2;.JAH DBBD| 72 7 788dB,0 0Ht~b))) 1 ss A A-,A-noncD|tjdSr)r1rtr)rrs r save_NoneTypez_Serializer.save_NoneTypes FK     rbooleanc|r!|tjdS|tjdSr)r1rtrr)rrs r save_boolz_Serializer.save_bools>  & KK $ $ $ $ $ KK % % % % %rbytes_rcn|tj||dSr)r1rtr_write_byte_sequencerrs r save_bytesz_Serializer.save_bytess0 FL!!! !!&)))))rrrLcn|tj||dSr)r1rtr_write_unicode_stringrs rsave_strz_Serializer.save_strs1 F$%%% ""1%%%%%rc |d}n"#t$r}td|d}~wwxYw||dS)Nrzstrings must be utf-8 encodable)encodeUnicodeEncodeErrorrlr)rrrrHs rr!z!_Serializer._write_unicode_stringsi Fxx((HH! F F F=>>A E F !!(+++++s 727cv|t|d||dS)Nzstring is too long) _write_int4rr1rs rrz _Serializer._write_byte_sequences7 V&:;;; Frr/r$short_oplong_opc.|tkr,||||dS|||t |dddS)NLascii)FOUR_BYTE_INT_MAXr1r'rrLrstripr$)rr/r(r)s r_save_integralz_Serializer._save_integrals ! ! ! KK ! ! !   Q      KK  % %c!ffmmC&8&8&?&?&H&H I I I I Irc\||tjtjdSr)r/rtrrrs rsave_intz_Serializer.save_ints$ Avz6>:::::rrc\||tjtjdSr)r/rtrr)rrs r save_longz_Serializer.save_longs$ Av{FO<<<<AR@T#T*****)))) $$$$ ,,,, 8888 4444 ''''----%%%%%%rrr,cvttds_ttjtj|}ddl}|jdt_|jdt_n tj}n%#t$rtj dkrd}nd}YnwxYw| tj ddd}tj |tj}tj|dtj|| tj ddd}tj |tj}tj|dtj dkrH| tj d ddt_tj|d tj|t|||}| dddd t_| dddd t_|S) NduprrrntNULz /dev/nullrfrrFr)hasattrrr$rstdoutstdintempfile TemporaryFiledevnullrrWrlrXrO_RDONLYdup2r7O_WRONLYr)r,rAr^r`r]rhr\s r init_popen_iords 2u  "@ cj#)Y 7 7*H*3// +X+C00  &jGG & & &w$%  &   C33 WWbk * * A  !!"&))S!44 WWbk * * A 7d??"))"&))S!<> %%aa%?? Is6 BB%$B%crtd|t||ddS)Nzcreating workergateway on rr)rArr3)rrNrX)rArs rrXrX s@ -r - -...RBA...4466666r)rPrrr+r)rrrrrrL)r)r$rr)rrrrrV)FF)rrrr=rr=rr)rAr"rr=rr=rrr)rrrkrrr)r,r+rr$)rAr*rr)`rJ __future__rrxrrEr tracebackrrrrArtypingrrrr r r r r rr"r*r<ABCMetar+r|rrrrrrrB SystemExitrenvironrDEBUGrrrr^pathr gettempdirfnrr notracer$r<rrorrrr9rrrrrrrQrrrrrQrNrhrlrnrprr-rcalcsizerrrrrrtr6rrrrrgrarrdrXrrrrrs  #""""" """"""11111h11133333X333          > > > > >H > > >2$2$2$2$2$#+2$2$2$2$j6!6!6!6!6!i6!6!6!r!!!!!o!!!6060606060 606060r7$7$7$7$7$i7$7$7$t ; ; ; ;"!"!"!"!"!"!"!"!Jy6y6y6y6y6y6y6y6x J' ''bikkC<< ( IIIOOO )h)++-?#-E F FBR I     (''Ge''''''''TcScScScScScScScSL22222y222 /-2"OOOOO)OOO&;;;;;7;;;fhhADADADADADADADADH FHH 'P a'a'a'a'a'a'a'a'H@@@@@@@@"     {   !!!!!k!!!HR+R+R+R+R+R+R+R+jd-d-d-d-d-Kd-d-d-X     i   --------////////T!WW #FOL11%fon55     I   4},},},},},},},},@3333>>>> QV.JOFFFFF*.>>>>>####B%B%B%B%B%B%B%B%J$$$$N777777r