@jV3 ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z da eaGddejZdZddZdZd Zejd Zdd Zd Zd ZGddejZdZdZdZdZdS)NFc:eZdZfdZdZdZdZfdZxZS)Loggerctj|g|Ri|tr|diddsot j}t |dkrKt|ddddd}t|d|dSdSdSdS)Nextra_snscrapeSuppressDumpLocalsFDumped stack and locals to )superlog dumpLocalsgetinspectstacklen_dump_stack_and_locals)selflevelargskwargsrname __class__s T/home/ubuntu/.hermes/hermes-agent/venv/lib/python3.11/site-packages/snscrape/_cli.py_log_with_stackzLogger._log_with_stacks %''+e%d%%%f%%%= 7B//334QSXYY= =??5 %jjAoo !%)DDbD/ 2 2D GGKK;T;;<<<<< ====oc<|jtjg|Ri|dSN)rloggingWARNINGrrrs rwarningzLogger.warning!s-$w888888888rc<|jtjg|Ri|dSr)rrERRORr!s rerrorz Logger.error$s-$w}6t666v66666rc<|jtjg|Ri|dSr)rrCRITICALr!s rcriticalzLogger.critical's.$w'9$999&99999rc|tjkr|j|g|Ri|dStj|g|Ri|dSr)rr rr r )rrrrrs rr z Logger.log*se go4/////////577;u&t&&&v&&&&&r) __name__ __module__ __qualname__rr"r%r(r __classcell__rs@rrrs~=====999777:::'''''''''rrc g}||d||d|d|j|d|d|j|d|d|jD]6}|d|dt d|j|7dD]}t ||rqt ||ra|d|d |d|t dt ||d dd |S) N =  z .method = .url = .headers = \ _)bodyparamsdata. ) appendmethodurlheaders_reprhasattrgetattrreplacejoin)rrequestretfieldattrs r_requests_request_reprrI1s| t # # # #$$$ 34 3 37> 3 3444 -4 - - - -... &4 & & &'''oFFU** De D Dc7?5+A B B D DEEEE 'HHT WdH 6 6H::%T%%D%%%&&&::eC$//0088vFFGGG  rTc g}||d||d|d|j|d|d|td|jdd|r|jr|d|d|jD]P}|d|t d|d ddQ|d |d|d |j|d|d |jD]6}|d|dtd|j|7|d|dtd|j d |S)Nr0r1r2z .request = r5r:z .history = [r4F) withHistoryz ]z.status_code = r3z .content = r;) r<r>r@rErChistory_requests_response_repr status_coder?contentrD)rresponserKrFpreviousResponserGs rrMrM@s  t $ $ $ $%%% .4 . . . ./// $4 $ $ $%%%E#x' ( ( 0 0v > >???H$** &D & & &'''"*kk::h::%c+;5QQQYYZ^`hiijjjj**W >4 > >(< > >??? &4 & & &'''GGU** Ee E Ec8+;E+B C C E EFFFF B4 B BE#x/?$@$@ B BCCC  rclg}||d||dt|d|jddz|dt|d|jddzd|S)Nr0r1z.requestr:z .responser;)r<r@rErCrPrD)rexcrFs r_requests_exception_reprrTTs t       FUd,,,ck::BB4PP PQQQFUd---s|<<DDT6RR RSSS  rcttjurtSttjtjfvrt Sttjj rtSttrcdtj dtj ddfdDzStt t"t$jfrwt)dDs^dtj dtj ddfdt+DzSt-jryttsddtj dtj ddfdt-jDzSd }d |vr+d d |d dgS|S) Nz = r1c3rK|]1\}}td|d|ddV2dS[]r:r1Nr@rC).0kvrs r z_repr..esR``$!QUd++Q+++Q//77fEE``````rc3NK|] }t|ttfV!dSr) isinstanceintstr)r[r]s rr^z_repr..fs4CmCmbcJqSVX[R\D]D]CmCmCmCmCmCmrc3rK|]1\}}td|d|ddV2dSrWrZ)r[ir]rs rr^z_repr..hsMaa1Ud>>Q>>>1--55dFCCaaaaaarc 3K|]h}td|j|jdztd|jt|jddzVidS)r9r0r:r1N)r@rrBrC)r[frvalues rr^z_repr..ksmmNOUd--QV--qv66>$GYGYQRQWGYGY[bchjkjp[q[qArArAzAz{BHBIBIImmmmmmrr0r:r;z\ )typerequestsResponserMPreparedRequestRequestrIr` exceptionsRequestExceptionrTdictr+r*rDitemslisttuple collectionsdequeall enumerate dataclasses is_dataclassfieldsrC)rrg valueReprs`` rr@r@\sKK8$$$ u - --KKH,h.>??? e , ,,uh):;;/ !$ . ..uda  J Jd5kk, J JtE{{/C J J J ````RWR]R]R_R_``` ` ` aautUK$5677bCmCmglCmCmCm@m@mb  J Jd5kk, J JtE{{/C J J J aaaaPYZ_P`P`aaa a a bbU##mJud,C,Cm  J Jd5kk, J JtE{{/C J J J mmmmmS^SefkSlSlmmm m m mm " " " "I (I--dF;;< = ==rc#K dVdS#t$rf}tj}t|dkr:t |dd|}t d|ddid}~wwxYw)Nr )rSr rT)r) Exceptionrtracerrloggerfatal)er~rs r_dump_locals_on_exceptionrrs%%%%% -//%ZZ1__ qrr! 4 4 44 <<4d44?\^b>c<ddd s A:A!A55A:c dtjddd5}||d|dt|jdt|jd|d |d |jd |d |d |D]l}|d |jd |jd|j d |j 5|j D]-}|d| d .m|d d|D}tt||D]\}\}}|2tt|D] }||n 5||}|jds |jdkrc|dj} |d|jd |jd|j d| D]} | | } t%| | } |d| dt| d|| d d|d |d d| vrmt)| ddrW|d|t+| dj|d|j} dddn #1swxYwY| S)Nwsnscrape_locals_F)prefixdeletez Exception: z r9: r:z args: zStack: z File "z", line z, in z cBg|]}tj|dS)r)r getmodule)r[ frameRecords r z*_dump_stack_and_locals..s' H H H;W {1~ . . H H Hrz snscrape.snscraperzLocals from file "z:  r0r1r__dict__z Object dict: z )tempfileNamedTemporaryFilewriterhr+r*rfilenamelinenofunction code_contextstriprvzipreversedrange startswithf_localsr@rCrAreprrr)r~rSfprlinemodulesrdmodulejlocals_ variableNamevariablevarReprrs rrr~s!#0BUSSS)WY_88N88 Gc% G GS (: G Gc G G GHHH88 %sx % % %&&&88D>>>((:''k88 f{+ f f[5G f fkNb f f fggg*(''XX%TZZ\\%%%&&&&((4... H H% H H H'"+C,?,?"@"@a &+ n eAhh    e  QZF / $ $[ 1 1 fo6S6S ^ $788 q!5 q q{?Q q qXcXl q q qrrr||$HL(++GHH 4, 4 4h 4 4 4555HHW__T6 * *+++HHTNNNN88D>>> GGFOZ@@HH HHT'&/* + +,,,HHV $S)))))))))))))))T sLL%%L),L)cdD]d} tj||}|j'|tjjcS|cS#t $rYawxYw tjt|tjj}|S#t $rYnwxYwtj d|d)N)z%Y-%m-%d %H:%M:%S %z%Y-%m-%d %H:%M:%Sz %Y-%m-%d %zz%Y-%m-%d)tzinfoz Cannot parse z into a datetime object) datetimestrptimerrCtimezoneutc ValueError fromtimestampraargparseArgumentTypeError)argformatds rparse_datetime_argrsW  V !!#v..1h 99h/39 4 4444 888     8  %%c#hh0A0EFF! ( $!"P#"P"P"PQQQs# A A%$A%)49$999&99999rc tjd}nJ#tjj$r3tdtj|dYnwxYwtd|dtd|dd |d td |d td |dtd|ddddddd|dvrttd|dS)NrzjError: could not find snscrape installation. --citation does not work without the package being installed.filer|zAuthor: authorzTitle: rrsummaryzURL: z home-pagez Version: versionu Date: 2018‒r9rz.devzWARNING! You are running a development version. The date range may be incorrect. Please adjust the upper end of the range to the year of the commit.) importlibmetadataPackageNotFoundErrorprintsysstderrexitr)rparser namespacevalues optionStringms r__call__zCitationAction.__call__sv"":..11   0 uBIJJJJ ;;q>>>>> 1X;  !!!-!F)--q|--... +  !!!"AiL""###;) **32215bqb9;;<<< q|777 `aaa++-----s"AA)(A))r*r+r,rSUPPRESSrrr-r.s@rrrsa+3+<:xO`:::::::rrc  ddl}ddl}ddl}tjtj ddd|jj dtdd  d d d d ddd ddddd dddtddd ddd fd dd!" d#}|d$d%d&tdd'(|d)d*ddd+|d,d-ddd. d/d0ddd1 d2td3d45 d6ddd78 d9d:d;d<=}|jj}i}|D]:}|j |||j<||;t)|D]W\}}||jd>tj?}||||@X }|js |jdkr dA|jrd<|_|S)BNr)formatter_classz --versionrz snscrape )actionrz --citationz1Display recommended citation information and exit)rnargshelpz-vz --verbosez --verbosity verbositycountzIncrease output verbosity)rrrrz --dump-localsr store_trueFzADump local variables on serious log messages (warnings or higher)z--retryz --retriesretriesrNzwWhen the connection fails or the server returns an unexpected response, retry up to N times with an exponential backoff)rrhrmetavarrz-nz --max-results maxResultscrt|dkrt|ndS)Nrz(--max-results N must be zero or positive)rar%)xrs rzparse_args..sG\_`a\b\bfg\g\gRUVWRXRXRXmsmymy{enfnfrzOnly return the first N results)rrhrr)requiredz-fz--formatrz Output format)rrhrrz--jsonljsonlz Output JSONLz--jsonl-for-buggy-int-parserjsonlForBuggyIntParserzgOutput JSONL and insert extra string fields into objects for integers exceeding double precision limitsz --with-entity withEntityz@Include the entity (e.g. user, channel) as the first output itemz--sinceDATETIMEz'Only return results newer than DATETIME)rhrrz --progresszReport progress on stderr)rrrscraperSCRAPERscrapersT)rrtitlerr;)rr)clsz:--max-results 0 is only valid when used with --with-entity) snscrape.basesnscrape.modulessnscrape.versionrArgumentParserArgumentDefaultsHelpFormatter add_argumentr __version__rraadd_mutually_exclusive_grouprradd_subparsersbaseScraper__subclasses__rextendsortedrp add_parser_cli_setup_parser set_defaults parse_argsrrr%rr) rgroup subparsersclassesrrr subparserrrs @rrrs  !H4Z [ [ [[9@jHL\Lh@j@jkkk\NAOBCCCT; kT[ghrMNNN_\L\aknoooY IcUVbe CDDDT?<IfIfIfIfru~_```  , , , > >D*XlVZcrsssIg PU^lmmm2;S^jv{Enooo_\L\akmnnnY'9ZYBCCC\LERmnnn##9 S]jn#oo = / / 1 1  ''SX8CH ..##%%&&&&HNN,,--$$\Wc##CHR8Kq#rr) """ s#### MDOq00,,KLLL$* rcjtjttjtadSr)rsetLoggerClassr getLoggerr*rrr setup_loggingrs'  H % %rc|atj}|dkrR|dkr tjn tj}|||jD]}||tjddd}|jD]}||tj }| || |dS)Nrr|z7{asctime}.{msecs:03.0f} {levelname} {name} {message}rr)datefmtstyle) rrrINFODEBUGsetLevelhandlers Formatter removeHandler StreamHandler setFormatter addHandler)r dumpLocals_ rootLoggerrhandler formatters rconfigure_loggingr!s!!MM#q..',,gm% e$g E XdwBEFFF#$$W 7####  " "i    wrc8tt}t|j|j|j|}d}t5 |jrH|j x}r?|j r)t| |j nt||jdkr(td ddddSt#|dD]7\}}|j5|j|jkr%td|jn;|j r)t| |j n>|j(t|j|nt||jr(|dzdkrtd|d t.j |jrQ||jkrFtd |d |jrtd |dt.j nF9td|d |jrtd|d t.j n|#t2$rot5jt5jt4jt4jt.j t/j!dYnwxYwddddS#1swxYwYdS)Nr)forBuggyIntParserzExiting after 0 resultsr|)startz+Exiting due to reaching older results than dz Scraping, z results so farrzExiting after z resultszStopped scraping after z results due to --max-resultsz Done, found z Finished, )"rrr!rrr_cli_from_argsrrentityrrjsonrrrinforv get_itemssincedaterprogressrrBrokenPipeErrorosdup2opendevnullO_WRONLYstdoutfilenor)rrrdr'items rmainr72sZ 4>4?333 8 " "4 ( (!!!!  oW^36 z 6;;4+F; G GHHHH 6]]] o KK)*** !!!!!!!!G--//;;;88wq$ z$)dj"8"8 [[KtzKKLLL U z 499)D9 E EFFFF   4;  d # #$$$$ 4[[[ }?SA * * * *3:>>>>  1// [[-!---... [ Fa F F FszZZZZ U KK*q***+++ }8 # # # #CJ7777 7272:r{ + +SZ->->-@-@AAA8A;;;;;?!!!!!!!!!!!!!!!!!!s?!L#A4J%F JLA6K?<L>K??LLL)Tr)rrs contextlibrwrimportlib.metadatarrrr/rirrrrrrIrMrTr@contextmanagerrrrrActionrrrr!r7rrrr<s    '''''W^'''2   (, + + + + \RRR(    X_.( ( ( V&&&    4(((((r