+ VizaRdtL0tRt^RIt^RIt^RIt^RIHtHtHtH t H t H t H t H t Ht^RIt^RIHt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIHtRt]!4t]P6!R4t]^k] !R4t!RR ]P<4t!R R ]P<4t !R R ]P<4t!!RR]P<4t"!RR]P<]],4t#!RR]P<4t$!RR]P<4t%!RR]P<4t&!RR]P<4t'!RR]P<4t(!RR]P<4t)!RR]P<4t*!R R!]P<4t+!R"R#]P<4t,!R$R%]P<4t-!R&R']P<4t.!R(R)]P<4t/!R*R+]P<4t0!R,R-]P<4t1!R.R/]P<4t2!R0R1]'4t3!R2R3]#],]],4t4!R4R5]P<4t5!R6R7]P<4t6!R8R9]P<4t7!R:R;]P<4t8!R<R=]P<4t9!R>R?]P<4t:!R@RA]P<4t;!RBRC]P<4t<!RDRE]P<4t=!RFRG]P<]],4t>!RHRI]P<4t?!RJRK]P<4t@!RLRM]P<4tA!RNRO]P<4tB!RPRQ]P<4tC!RRRS]P<4tD!RTRU]P<4tE!RVRW]P<4tF!RXRY]P<4tG!RZRK]P<4t@!R[RE]P<4t=!R\R]4tH!R^R_4tI!R`Ra]H4tJ!RbRc]I4tKR#)ea FirecrawlApp Module This module provides a class `FirecrawlApp` for interacting with the Firecrawl API. It includes methods to scrape URLs, perform searches, initiate and monitor crawl jobs, and check the status of these jobs. The module uses requests for HTTP communication and handles retries for certain HTTP status codes. Classes: - FirecrawlApp: Main class for interacting with the Firecrawl API. N) AnyDictOptionalListUnionCallableLiteralTypeVarGeneric)datetime)Fieldc^RIHp\PP \ 4pV!\PP VR44P4p\P!RV\P4pV'd VP^4P4#R# \d\R4R#i;i))Pathz __init__.pyz"^__version__ = ['\"]([^'\"]*)['\"]z&Failed to get version from __init__.pyN)pathlibrospathdirname__file__join read_textresearchMgroupstrip Exceptionprint)r package_path version_file version_matchs Y/home/ubuntu/hermes-agent/venv/lib/python3.14/site-packages/firecrawl/firecrawl.backup.py get_versionr"s WW__X.l"'',,|]CDNNPlii E|UWUYUYZm $$Q'--/ /   45 sB B. B..CC firecrawlTc8a]tRt^QtoRtRtRtV3RltRtVt R#) AgentOptionszConfiguration for the agent.FIRE-1NcP<V^8dQh/S[R,;R&S[S[,;R&#)r'modelpromptrrstr)format __classdict__s"r! __annotate__AgentOptions.__annotate__Qs& 8 ' SM ) __name__ __module__ __qualname____firstlineno____doc__r*r+__annotate_func____static_attributes____classdictcell__r/s@r!r&r&Qs&'E Fr2r&c4a]tRt^VtoRtRtV3RltRtVtR#)AgentOptionsExtract2Configuration for the agent in extract operations.r'c4<V^8dQh/S[R,;R&#r)r'r*r)r.r/s"r!r0 AgentOptionsExtract.__annotate__V 8 'r2r3N r4r5r6r7r8r*r9r:r;r<s@r!r>r>V<'Er2r>c0a]tRt^ZtoRtV3RltRtVtR#) ActionsResultz,Result of actions performed during scraping.cR<V^8dQh/S[S[,;R&S[S[,;R&#)r) screenshotspdfs)rr-)r.r/s"r!r0ActionsResult.__annotate__Zs$c s)Or2r3Nr4r5r6r7r8r9r:r;r<s@r!rHrHZs6r2rHc`a]tRt^_toRtRtRt]P!RRR7t V3Rlt Rt Vt R#)ChangeTrackingDataz& Data for the change tracking format. Njsonaliasc<V^8dQh/S[S[,;R&S[;R&S[;R&S[S[S[S[3,,;R&S[S[,;R&#)r)previousScrapeAt changeStatus visibilitydiff json_field)rr-rr)r.r/s"r!r0ChangeTrackingData.__annotate___sZsm*    O  4S> ") Br2r3) r4r5r6r7r8rTrWpydanticr rXr9r:r;r<s@r!rOrO_s0'+&*D (t6 BJr2rOca]tRt^itoRtRtRtRtRtRt Rt ] P!RRR7t RtRtRtRtRtRtV3RltRtVtR#)FirecrawlDocumentz-Document retrieved or processed by Firecrawl.NrPrQc<V^8dQh/S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[S[,,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R &S[S[,;R &S[S[,;R &S[S[,;R &S[S[,;R &#)r)urlmarkdownhtmlrawHtmllinksextractrX screenshotmetadataactionstitle descriptionchangeTracking)rr-rr$rrHrO)r.r/s"r!r0FirecrawlDocument.__annotate__is #sm" 3-  c]!  DI % a[ @ $sm"m $+ C=#%/07r2r3)r4r5r6r7r8r^r_r`rarbrcrZr rXrdrerfrgrhrir9r:r;r<s@r!r\r\is[7C"HD!G!%EG&nnT@J $J"H'+GE!%K37Nr2r\c8a]tRt^ytoRtRtRtV3RltRtVt R#)LocationConfigz$Location configuration for scraping.Ncb<V^8dQh/S[S[,;R&S[S[S[,,;R&#)r)country languages)rr-r)r.r/s"r!r0LocationConfig.__annotate__ys* c]!S ")r2r3) r4r5r6r7r8rnror9r:r;r<s@r!rlrlys.!G%)Ir2rlc<a]tRt^~toRtRtRtRtV3RltRt Vt R#) WebhookConfigzConfiguration for webhooks.Nc<V^8dQh/S[;R&S[S[S[S[3,,;R&S[S[S[S[3,,;R&S[S[S[R,,,;R&#)r)r^headersreevents) completedfailedpagestarted)r-rrrr)r.r/s"r!r0WebhookConfig.__annotate__~s` Hd38n %,tCH~&-  T'"JKL MT r2r3) r4r5r6r7r8rtrerur9r:r;r<s@r!rrrr~s%(,G)-HPTF r2rrcda]tRt^toRtRt]P!RRR7tRt Rt V3Rlt Rt Vt R#)ChangeTrackingOptionsz"Configuration for change tracking.NschemarQc<V^8dQh/S[S[S[R,,,;R&S[S[,;R&S[S[,;R&S[S[,;R&#)r)modes schema_fieldr+tag)zgit-diffrP)rrrrr-)r.r/s"r!r0"ChangeTrackingOptions.__annotate__sS D!345 6=3-F SM  # r2r3)r4r5r6r7r8rrZr rr+rr9r:r;r<s@r!r|r|s.,9=E"*..X"FL FC r2r|cta]tRt^toRtRtRtRtRtRt Rt Rt Rt Rt RtRtRtRtRtRtRtRtV3RltRtVtR#) ScrapeOptions#Parameters for scraping operations.N0ucX<V^8dQh/S[S[S[R,,,;R&S[S[S[S[3,,;R&S[S[S[,,;R&S[S[S[,,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R &S[S[,;R &S[S[,;R &S[S[,;R &S[S[R,,;R &S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&#)r)formatsrt includeTags excludeTagsonlyMainContentwaitFortimeoutlocationmobileskipTlsVerificationremoveBase64ImagesblockAdsproxychangeTrackingOptionsmaxAge storeInCacheparsePDF r_r`racontentrbrdscreenshot@fullPagercrPribasicstealthauto) rrrrr-boolintrlr|)r.r/s"r!r0ScrapeOptions.__annotate__s\ d7$_`abid38n %,$s)$+  $s)$+  d^* c]!c]"~&- TN!"$.!-tn# G67 8?$$9:A SM !"4.'#$tn#%r2r3)r4r5r6r7r8rrtrrrrrrrrrrrrrrrr9r:r;r<s@r!rrsk-eiG(,G'+K'+K&*O!G"G)-H!F*.)-#H;?E=A F#'L#H%r2rc8a]tRt^toRtRtRtV3RltRtVt R#) WaitActionz'Wait action to perform during scraping.Ncl<V^8dQh/S[R,;R&S[S[,;R&S[S[,;R&#)r)waittype millisecondsselector)rrrr-)r.r/s"r!r0WaitAction.__annotate__s6 &/3-&sm" r2r3) r4r5r6r7r8rrr9r:r;r<s@r!rrs1"&L"H r2rc8a]tRt^toRtRtRtV3RltRtVt R#)ScreenshotActionz-Screenshot action to perform during scraping.Ncl<V^8dQh/S[R,;R&S[S[,;R&S[S[,;R&#)r)rdrfullPagequality)rrrr)r.r/s"r!r0ScreenshotAction.__annotate__s7 , tn#c]! r2r3) r4r5r6r7r8rrr9r:r;r<s@r!rrs7#H!G r2rc0a]tRt^toRtV3RltRtVtR#) ClickActionz(Click action to perform during scraping.c@<V^8dQh/S[R,;R&S[;R&#)r)clickrrrr-)r.r/s"r!r0ClickAction.__annotate__s! ' Mr2r3NrMr<s@r!rr2r2rc0a]tRt^toRtV3RltRtVtR#) WriteActionz(Write action to perform during scraping.c@<V^8dQh/S[R,;R&S[;R&#)r)writertextr)r.r/s"r!r0WriteAction.__annotate__s! '  Ir2r3NrMr<s@r!rrrr2rc0a]tRt^toRtV3RltRtVtR#) PressActionz(Press action to perform during scraping.c@<V^8dQh/S[R,;R&S[;R&#)r)pressrkeyr)r.r/s"r!r0PressAction.__annotate__s! '  Hr2r3NrMr<s@r!rrrr2rc4a]tRt^toRtRtV3RltRtVtR#) ScrollActionz)Scroll action to perform during scraping.Ncj<V^8dQh/S[R,;R&S[R,;R&S[S[,;R&#)r)scrollr directionr)updownr,)r.r/s"r!r0ScrollAction.__annotate__s8 ( |$$sm" r2r3) r4r5r6r7r8rr9r:r;r<s@r!rrs3#H r2rc0a]tRt^toRtV3RltRtVtR#) ScrapeActionz)Scrape action to perform during scraping.c4<V^8dQh/S[R,;R&#)r)scraperrB)r.r/s"r!r0ScrapeAction.__annotate__s ( r2r3NrMr<s@r!rrs3r2rc0a]tRt^toRtV3RltRtVtR#)ExecuteJavascriptActionz5Execute javascript action to perform during scraping.c@<V^8dQh/S[R,;R&S[;R&#)r)executeJavascriptrscriptr)r.r/s"r!r0$ExecuteJavascriptAction.__annotate__s" % && Kr2r3NrMr<s@r!rrs?r2rc<a]tRt^toRtRtRtRtV3RltRt Vt R#) PDFActionz&PDF action to perform during scraping.Nc<V^8dQh/S[R,;R&S[S[R,,;R&S[S[,;R&S[S[,;R&#)r)pdfrr. landscapescale) A0A1A2A3A4A5A6LetterLegalTabloidLedger)rrrfloat)r.r/s"r!r0PDFAction.__annotate__sN %. Wmn ov~$  E?! r2r3) r4r5r6r7r8r.rrr9r:r;r<s@r!rrs0rvF $I!E r2rc4a]tRt^toRtRtV3RltRtVtR#) ExtractAgentr?r'c4<V^8dQh/S[R,;R&#rArB)r.r/s"r!r0ExtractAgent.__annotate__rDr2r3NrEr<s@r!rrrFr2rcda]tRt^toRtRt]P!RRR7tRt Rt V3Rlt Rt Vt R#) JsonConfigzConfiguration for extraction.Nr}rQc<V^8dQh/S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&#)r)r+r systemPromptagent)rr-rr)r.r/s"r!r0JsonConfig.__annotate__sH SM 3-F3-&  L !( r2r3)r4r5r6r7r8r+rZr rrrr9r:r;r<s@r!rrs.' F"*..X"FL"&L$(E r2rcDa]tRt^toRtRtRtRtRtRt V3Rlt Rt Vt R#) ScrapeParamsrNc <V^8dQh/S[S[,;R&S[S[,;R&S[S[S[S[S[S[S[S[S[ S[ S[ S[ 3 ,,,;R&S[S[ ,;R&S[S[,;R&#)r)rc jsonOptionsrfrwebhook)rrrrrrrrrrrrrr&rr)r.r/s"r!r0ScrapeParams.__annotate__s j !(*%,d5-={KYdfruACZ\e"efgho  L !(  m $+ r2r3) r4r5r6r7r8rcrrfrrr9r:r;r<s@r!rrs,-$(G(,KkoG$(E'+G r2rc<a]tRt^toRtRtRtRtV3RltRt Vt R#)ScrapeResponsez"Response from scraping operations.TNc^<V^8dQh/S[;R&S[S[,;R&S[S[,;R&#)r)successwarningerror)rrr-)r.r/s"r!r0ScrapeResponse.__annotate__s2 c]! C= r2r3 r4r5r6r7r8rrrr9r:r;r<s@r!rrs,G!GE r2rcDa]tRt^toRtRtRtRtRtRt V3Rlt Rt Vt R#)BatchScrapeResponsez&Response from batch scrape operations.NTc<V^8dQh/S[S[,;R&S[S[,;R&S[;R&S[S[,;R&S[S[S[,,;R&#)r)idr^rr invalidURLs)rr-rr)r.r/s"r!r0 BatchScrapeResponse.__annotate__sY  #  C=  $s)$+ r2r3) r4r5r6r7r8rr^rrrr9r:r;r<s@r!rrs(0BCGE'+K r2rc8a]tRt^toRtRtRtV3RltRtVt R#)BatchScrapeStatusResponsez)Response from batch scrape status checks.TNc<V^8dQh/S[;R&S[R ,;R&S[;R&S[;R&S[;R&S[;R&S[S[,;R&S[S[,;R&# r)rrvstatustotal creditsUsed expiresAtnextdata)scrapingrvrw cancelledrrrr rr-rr\)r.r/s"r!r0&BatchScrapeStatusResponse.__annotate__y  B CCN  J    3-  !!r2r3 r4r5r6r7r8rrr9r:r;r<s@r!rrs3G Dr2rcta]tRt^toRtRtRtRtRtRt Rt Rt Rt Rt RtRtRtRtRtRtRtRtV3RltRtVtR#) CrawlParamsz#Parameters for crawling operations.Nc,<V^8dQh/S[S[S[,,;R&S[S[S[,,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R &S[S[,;R &S[S[S[S[3,,;R &S[S[,;R &S[S[,;R &S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&#)r) includePaths excludePathsmaxDepthmaxDiscoveryDepthlimitallowBackwardLinkscrawlEntireDomainallowExternalLinks ignoreSitemap scrapeOptionsrdeduplicateSimilarURLsignoreQueryParametersregexOnFullURLdelaymaxConcurrencyallowSubdomains)rrr-rrrrrr)r.r/s"r!r0CrawlParams.__annotate__s:49%,49%,sm"   }+  C= !- ~,!-D>(M*1eC./ 07%TN1$D>0TN) C=!"SM(#$d^*%r2r3)r4r5r6r7r8rrrrrrr r!r"r#rr$r%r&r'r(r)r9r:r;r<s@r!rrsj-(,L(,L"H'+E)-(,)-$(M-1M37G-1,0%)NE$(N&*O%r2rc@a]tRtRtoRtRtRtRtRtV3Rlt Rt Vt R#) CrawlResponseiz"Response from crawling operations.NTcz<V^8dQh/S[S[,;R&S[S[,;R&S[;R&S[S[,;R&#)r)rr^rr)rr-r)r.r/s"r!r0CrawlResponse.__annotate__sC  #  C= r2r3) r4r5r6r7r8rr^rrr9r:r;r<s@r!r,r,s#,BCGE r2r,c8a]tRtRtoRtRtRtV3RltRtVt R#)CrawlStatusResponseiz"Response from crawl status checks.TNc<V^8dQh/S[;R&S[R ,;R&S[;R&S[;R&S[;R&S[;R&S[S[,;R&S[S[,;R&#r r)r.r/s"r!r0 CrawlStatusResponse.__annotate__rr2r3rr<s@r!r0r0s,G Dr2r0c0a]tRtRtoRtV3RltRtVtR#)CrawlErrorsResponsei#z2Response from crawl/batch scrape error monitoring.ch<V^8dQh/S[S[S[S[3,,;R&S[S[,;R&#)r)errors robotsBlocked)rrr-)r.r/s"r!r0 CrawlErrorsResponse.__annotate__#s. c3h  9r2r3NrMr<s@r!r4r4#s<r2r4cLa]tRtRtoRtRtRtRtRtRt Rt Rt V3Rlt Rt VtR#) MapParamsi(z"Parameters for mapping operations.Nrc<V^8dQh/S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&#)r)rr"includeSubdomains sitemapOnlyrruseIndex)rr-rr)r.r/s"r!r0MapParams.__annotate__(sz SM D>( ~,  $&  C= c]"tn#r2r3)r4r5r6r7r8rr"r<r=rrr>r9r:r;r<s@r!r:r:(s3, F$(M(,"&KE"G#Hr2r:c<a]tRtRtoRtRtRtRtV3RltRt Vt R#) MapResponsei2z!Response from mapping operations.TNcn<V^8dQh/S[;R&S[S[S[,,;R&S[S[,;R&#)r)rrbr)rrrr-)r.r/s"r!r0MapResponse.__annotate__2s7  DI % C= r2r3) r4r5r6r7r8rrbrr9r:r;r<s@r!rArA2s+G!%EE r2rAcxa]tRtRtoRtRt]P!RRR7tRt Rt Rt Rt Rt RtRtV3RltRtVtR#) ExtractParamsi8z0Parameters for extracting information from URLs.Nr}rQc<V^8dQh/S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R &#) r)r+rrr!enableWebSearchr<origin showSourcesr#)rr-rrr)r.r/s"r!r0ExtractParams.__annotate__8s SM 3-F3-&  !-  d^*  ~, SM $&M*1r2r3)r4r5r6r7r8r+rZr rrr!rGr<rHrIr#r9r:r;r<s@r!rErE8sI: F"*..X"FL"&L)-&*O(, F"&K-1Mr2rEcPa]tRtRtoRtRtRtRtRtRt Rt Rt Rt V3Rlt RtVtR#)ExtractResponseiDz!Response from extract operations.NTc<V^8dQh/S[S[,;R&S[S[R ,,;R&S[S[,;R&S[;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[S[S[3,,;R&#) r)rr rrrrrsources processingrvrw)rr-rr rr$rr)r.r/s"r!r0ExtractResponse.__annotate__Ds  W@A BI!(    1+  C=c]!d38n %,r2r3)r4r5r6r7r8rr rrrrrrNr9r:r;r<s@r!rLrLDs7+BEIF$(IGDE!G(,Gr2rLcPa]tRtRto^tRtRtRtRtRt Rt Rt Rt V3Rlt RtVtR#) SearchParamsiONenusapii`c"<V^8dQh/S[;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R &S[S[,;R &#) r)queryrtbsfilterlangrnrrHrr#)r-rrr)r.r/s"r!r0SearchParams.__annotate__Os J C= # SM  3-  c]! sm" SM!c]"M*1r2r3)r4r5r6r7rrYrZr[rnrrHrr#r9r:r;r<s@r!rSrSOs9EC FD!G"H!F"G-1Mr2rSc<a]tRtRtoRtRtRtRtV3RltRt Vt R#)SearchResponsei[z Response from search operations.TNcz<V^8dQh/S[;R&S[S[,;R&S[S[,;R&S[S[,;R&#r)rrrr)rrr\rr-)r.r/s"r!r0SearchResponse.__annotate__[sE   !!c]!  C= r2r3rr<s@r!r^r^[s*G!GE r2r^c@a]tRtRtoRt^ tRtRtRtV3Rlt Rt Vt R#)GenerateLLMsTextParamsibz3 Parameters for the LLMs.txt generation operation. FTNc<V^8dQh/S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&#)r)maxUrls showFullTextcache,_GenerateLLMsTextParams__experimental_stream)rrr)r.r/s"r!r0#GenerateLLMsTextParams.__annotate__bsIc]  4.(  D> $D>0r2r3) r4r5r6r7r8rerfrgrhr9r:r;r<s@r!rcrcbs( G#(L E,0r2rccHa]tRtRtoRt^tRt^tRtRt Rt V3Rlt Rt Vt R#)DeepResearchParamsikz- Parameters for the deep research operation. iNc<V^8dQh/S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&#)r)r timeLimitreanalysisPromptr-_DeepResearchParams__experimental_streamSteps)rrr-r)r.r/s"r!r0DeepResearchParams.__annotate__ksksm  }"  c] SM(3-&!)5r2r3)r4r5r6r7r8rrmrernrror9r:r;r<s@r!rkrkks2 H"IG$(N"&L15r2rkc4a]tRtRtoRtRtV3RltRtVtR#)DeepResearchResponseivz, Response from the deep research operation. NcN<V^8dQh/S[;R&S[;R&S[S[,;R&#r)rrrrr-r)r.r/s"r!r0!DeepResearchResponse.__annotate__vs.M  G  C= r2r3) r4r5r6r7r8rr9r:r;r<s@r!rrrrvs  E r2rrc8a]tRtRtoRtRtRtV3RltRtVt R#)DeepResearchStatusResponsei~z3 Status response from the deep research operation. Nc$<V^8dQh/S[;R&S[S[S[S[3,,;R&S[;R&S[S[,;R&S[;R&S[;R&S[;R&S[S[S[S[3,,;R&S[S[S[S[3,,;R &S[S[,;R &#) r)rrr rr currentDepthr activitiesrN summaries)rrrr-rrr)r.r/s"r!r0'DeepResearchStatusResponse.__annotate__~sM  4S> ")  K  C=NMT#s(^$$$sCx. !!Cyr2r3) r4r5r6r7r8rrr9r:r;r<s@r!rxrx~s&*DEr2rxc8a]tRtRtoRtRtRtV3RltRtVt R#)GenerateLLMsTextResponseiz-Response from LLMs.txt generation operations.TNcN<V^8dQh/S[;R&S[;R&S[S[,;R&#rtru)r.r/s"r!r0%GenerateLLMsTextResponse.__annotate__s-  G C= r2r3) r4r5r6r7r8rrr9r:r;r<s@r!rrs7GE r2rc0a]tRtRtoRtV3RltRtVtR#)"GenerateLLMsTextStatusResponseDataNcB<V^8dQh/S[;R&S[S[,;R&#)r)llmstxt llmsfulltxt)r-r)r.r/s"r!r0/GenerateLLMsTextStatusResponseData.__annotate__s L#%r2r3)r4r5r6r7rr9r:r;r<s@r!rrs!%Kr2rc<a]tRtRtoRtRtRtRtV3RltRt Vt R#)GenerateLLMsTextStatusResponseiz4Status response from LLMs.txt generation operations.TNc<V^8dQh/S[;R&S[S[,;R&S[R,;R&S[S[,;R&S[;R&#)r)rrr rrrO)rrrrr-)r.r/s"r!r0+GenerateLLMsTextStatusResponse.__annotate__sS  5 6= 7 88  C=  N r2r3) r4r5r6r7r8rrrr9r:r;r<s@r!rrs>G9=DE r2rc8a]tRtRtoRtRtRtV3RltRtVt R#)r^iz% Response from the search operation. Nc<V^8dQh/S[;R&S[S[S[S[3,,;R&S[S[,;R&S[S[,;R&#r`)rrrr-rr)r.r/s"r!r0rasMM  tCH~   c]!  C=r2r3) r4r5r6r7r8rrr9r:r;r<s@r!r^r^s "GEr2cta]tRtRtoRtRt]P!RRR7tRt Rt Rt Rt Rt RtV3RltRtVtR#) rEiz' Parameters for the extract operation. Nr}rQFc<V^8dQh/S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[,;R&S[S[S[S[3,,;R&#) r)r+r system_promptallow_external_linksenable_web_searchrG show_sourcesr)rr-rrr)r.r/s"r!r0rJs SM  3-F  C=' #4.0 ~-d^+4.( DcN #*r2r3)r4r5r6r7r8r+rZr rrrrrGrrr9r:r;r<s@r!rErEsH!F"*..X"FL#'M+0(-&+O#(L&*Er2c,a]tRtRtoRV3RlRlltRRRRRRRRR RR RR R R RRRRRRRRRRRRRRRRRRRRRRRRRRRRR/V3RlRlltRRRRR RR!RR"RR RR R R#R/V3R$lR%lltR&RR'RR(RR)RRRR*RR+RR,RR-RR#RR.RR/RR0RR1RR2RR3RR4RRRR5^R6R/V3R7lR8lltR&RR'RR(RR)RRRR*RR+RR,RR-RR#RR.RR/RR0RR1RR2RR3RR4RRRR6R/V3R9lR:lltV3R;lR<lt V3R=lR>lt V3R?lR@lt R&RR'RR(RR)RRRR*RR+RR,RR-RR#RR.RR/RR0RR1RR2RR3RR4RRRR6R/V3RAlRBllt RCRR-RRDRRERRRR R RFR/V3RGlRHllt RRRRRRRRR RR RR R R RRRRRRRRRRRRRRRRRRRR5^R4RRRR6R/V3RIlRJlltRRRRRRRRR RR RR R R RRRRRRRRRRRRRRRRRRRR4RR6RRR/V3RKlRLlltRRRRRRRRR RR RR R R RRRRRRRRRRRRRRRRRRRR4RRRR6R/V3RMlRNlltV3ROlRPltV3RQlRRltRRSRRTRRURR,RVRWRVRXRVRR/V3RYlRZllltV3R[lR\ltRRSRRTRRURR,RVRWRVRXRVRR/V3R]lR^llltR_RR`RRaRRbR/V3RclRdlltR_RR`RRaRRbR/V3RelRflltV3RglRhltRV3RilRjlltRV3RklRllltRV3RmlRnlltRV3RolRplltV3RqlRrltV3RslRtltV3RulRvltR(RRwRR_RRxRRURRyRRzRR{R/V3R|lR}llt R(RRwRR_RRxRRURRyR/V3R~lRllt!V3RlRlt"V3RlRlt#Rt$Rt%Vt&R#) FirecrawlAppiNcJ<V^8dQhRS[S[,RS[S[,RR/#)r)api_keyapi_urlreturnN)rr-)r.r/s"r!r0FirecrawlApp.__annotate__s0OO Ox}OX\Or2c ^T;'g\P!R4VnT;'g\P!RR4VnRVP9d/VPf!\P R4\ R4h\PRVP 24R#) z Initialize the FirecrawlApp instance with API key, API URL. Args: api_key (Optional[str]): API key for authenticating with the Firecrawl API. api_url (Optional[str]): Base URL for the Firecrawl API. FIRECRAWL_API_KEYFIRECRAWL_API_URLzhttps://api.firecrawl.devzapi.firecrawl.devNz%No API key provided for cloud servicezNo API key providedz'Initialized FirecrawlApp with API URL: )rgetenvrrloggerr ValueErrordebug)selfrrs&&&r!__init__FirecrawlApp.__init__s@@")),?"@ ]]")),?A\"]  $,, .4<<3G NNB C23 3 >t||nMNr2rrt include_tags exclude_tagsonly_main_contentwait_forrrrrskip_tls_verificationremove_base64_images block_adsr parse_pdfrc json_optionsrfchange_tracking_optionsmax_agestore_in_cachezero_data_retentionrc1<V^8dQhRS[RS[S[S[R,,,RS[S[S[S[3,,RS[S[S[,,RS[S[S[,,RS[S[,RS[S[,R S[S[,R S[S[,R S[S[,R S[S[,R S[S[,RS[S[,RS[S[R,,RS[S[,RS[S[,RS[S[,RS[S[S[ S[ S[ S[ S[ S[S[S[S[S[3 ,,,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,/#)r)r^rrcrtrrrrrrrrrrrrrrfrrrrrrrr)r-rrrrrrrlrrrrrrrrrrrr|r&rr)r.r/s"r!r0rsY7Y7Y7d7,g$hij Y7 d38n- Y7 #49- Y7#49-Y7 (~Y7smY7c]Y7~.Y7TNY7$,D>Y7#+4.Y7 ~Y7 G$>?@!Y7" ~#Y7$j)%Y7&#:.'Y7(d55E{T_alnz}IKbdm*m$nop)Y7*&..C%D+Y7,c]-Y7.%TN/Y70"*$1Y72L)3Y74(,5Y7r2c 6VPVR4VP4pRVRR\ 2/pV'dVVR&V'dVVR&V'dVVR&V'dVVR&VeVVR &V'dVVR &V'dVVR &V 'dV PR R R7VR&V eV VR&V eV VR&V eV VR&V eV VR&V'dVVR&VeVVR&VexVP V4p\ V\4'd#RV9dVP VR,4VR&\ V\4'dTMVPR R R7VR&VexVP V4p\ V\4'd#RV9dVP VR,4VR&\ V\4'dTMVPR R R7VR&V'd?VUu.uF.p\ V\4'dTMVPR R R7NK0 upVR&V'd/\ V\4'dTMVPR R R7VR&VeVVR&VeVVR&VeVVR&VeVPR R R7VR&VP V4RV9dGVR,'d8RVR,9d*VP VR,R,4VR,R&RV9dGVR,'d8RVR,9d*VP VR,R,4VR,R&\P!VP R2TTVeVR , ^,MR R!7pVP^8XdlVP4pVPR"4'dR#V9d\R(/VR#,B#R$V9d\R%VR$, 24h\R%V 24hVP!VR'4R #uupi \d \R&4hi;i))a Scrape and extract content from a URL. Args: url (str): Target URL to scrape formats (Optional[List[Literal["markdown", "html", "rawHtml", "content", "links", "screenshot", "screenshot@fullPage", "extract", "json"]]]): Content types to retrieve (markdown/html/etc) headers (Optional[Dict[str, str]]): Custom HTTP headers include_tags (Optional[List[str]]): HTML tags to include exclude_tags (Optional[List[str]]): HTML tags to exclude only_main_content (Optional[bool]): Extract main content only wait_for (Optional[int]): Wait for a specific element to appear timeout (Optional[int]): Request timeout (ms) location (Optional[LocationConfig]): Location configuration mobile (Optional[bool]): Use mobile user agent skip_tls_verification (Optional[bool]): Skip TLS verification remove_base64_images (Optional[bool]): Remove base64 images block_ads (Optional[bool]): Block ads proxy (Optional[Literal["basic", "stealth", "auto"]]): Proxy type (basic/stealth) extract (Optional[JsonConfig]): Content extraction settings json_options (Optional[JsonConfig]): JSON extraction settings actions (Optional[List[Union[WaitAction, ScreenshotAction, ClickAction, WriteAction, PressAction, ScrollAction, ScrapeAction, ExecuteJavascriptAction, PDFAction]]]): Actions to perform change_tracking_options (Optional[ChangeTrackingOptions]): Change tracking settings zero_data_retention (Optional[bool]): Whether to delete data after scrape is done agent (Optional[AgentOptions]): Agent configuration for FIRE-1 model Returns: ScrapeResponse with: * Requested content formats * Page metadata * Extraction results * Success/error status Raises: Exception: If scraping fails scrape_urlr^rH python-sdk@rrtrrNrrrTby_alias exclude_nonerrrrrrrr}rcrrfrrrzeroDataRetentionr /v1/scrape@@rtrPrrrrFailed to scrape URL. Error: +Failed to parse Firecrawl response as JSON.z scrape URLr3)_validate_kwargs_prepare_headersversiondict_ensure_schema_dict isinstanceupdaterequestspostr status_coderPgetrrr _handle_error)rr^rrtrrrrrrrrrrrrrcrrfrrrrrkwargs_headers scrape_paramsactionresponse response_jsons&&$$$$$$$$$$$$$$$$$$$$$$, r!rFirecrawlApp.scrape_urls@ fl3((* 3  G9- '.M) $ '.M) $ +7M- ( +7M- (  (/@M+ , '/M) $ '.M) $ (0 tRV (WM* %  &,M( # ,3HM/ 0  +2FM. /  (1M* % %*M' "  (1M* %  ..w7G'4((X-@$($<$&P%P>*PPrrYrZr[rnscrape_optionsc<V^8dQhRS[RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,R S[S[,R S[/ #) r)rXrrYrZr[rnrrrr)r-rrrr^)r.r/s"r!r0rds]3]3]3C= ]3 # ]3 SM ]33-]3c]]3sm]3c]]3%]3]3(]3r2c 2VPV R4/p VeW+R&VeW;R&VeWKR&VeW[R&VeWkR&VeW{R&VeWR &V eV PR R R 7V R &V PV 4V PR 4p \ RRV/V Bp V PR R R 7pR\ 2VR&V 'dWR &\ P!VP R2RRVP 2/VR7pVP^8XdeVP4pVPR4'dRV9d \R/VB#RV9d\RVR, 24h\RV 24hVPVR4R# \d \R4hi;i)a Search for content using Firecrawl. Args: query (str): Search query string limit (Optional[int]): Max results (default: 5) tbs (Optional[str]): Time filter (e.g. "qdr:d") filter (Optional[str]): Custom result filter lang (Optional[str]): Language code (default: "en") country (Optional[str]): Country code (default: "us") location (Optional[str]): Geo-targeting timeout (Optional[int]): Request timeout in milliseconds scrape_options (Optional[ScrapeOptions]): Result scraping configuration **kwargs: Additional keyword arguments for future compatibility Returns: SearchResponse: Response containing: * success (bool): Whether request succeeded * data (List[FirecrawlDocument]): Search results * warning (Optional[str]): Warning message if any * error (Optional[str]): Error message if any Raises: Exception: If search fails or response cannot be parsed rNrrYrZr[rnrrTrr# integrationrXrrH /v1/search AuthorizationBearer rtrPrrrzSearch failed. Error: rr3)rrrrrSrrrrrrrPr^rrr)rrXrrYrZr[rnrrrr search_params _integration final_params params_dictrrs&&$$$$$$$$, r!rFirecrawlApp.searchdsN fh/   %*' " ?#&%  &,( #  $(& !  '.) $  (0* %  '.) $  %-;-@-@$]a-@-bM/ * V$$((7 $A%A=A "''D'I "-gY 7 H )5 &==||nJ '$ ~&>?    3 & O (   $$Y//Fm4K):M:: -#&<]7=S#@<$}%@<&#4.'@<("#)@<*&d^+@<, }-@<."#/@<2 3@L) *  $)L !  '.>L* +  &-#z<$}%z<&#4.'z<("#)z<*&d^+z<,"#-z<0 1zL) *  $)L !  '.>L* +  &-a P"MOO$`&/2]&_ _ )""LL+LQC)PQ!"s= G=AH H #H= H  HH I (II c&<V^8dQhRS[RS[/#rr-r4)r.r/s"r!r0rs??S?-@?r2c VP4pVPVP RV R2V4pVP^8Xd\ R/VP 4B#VPVR4R# \ R4h;i)a Returns information about crawl errors. Args: id (str): The ID of the crawl job Returns: CrawlErrorsResponse containing: * errors (List[Dict[str, str]]): List of errors with fields: - id (str): Error ID - timestamp (str): When the error occurred - url (str): URL that caused the error - error (str): Error message * robotsBlocked (List[str]): List of URLs blocked by robots.txt Raises: Exception: If error check fails r/errorsrzcheck crawl errorsNr3rrrrr4rPrrrrrtrs&& r!check_crawl_errorsFirecrawlApp.check_crawl_errorss&'')$$ ~Zt7%KWU   3 & P*=X]]_==   x)= > P"MOO A22 A?c<<V^8dQhRS[RS[S[S[3,/#rr-rr)r.r/s"r!r0r1s#==s=tCH~=r2c VP4pVPVP RV 2V4pVP^8XdVP 4#VP VR4R# \ R4h;i)- Cancel an asynchronous crawl job. Args: id (str): The ID of the crawl job to cancel Returns: Dict[str, Any] containing: * success (bool): Whether cancellation was successful * error (str, optional): Error message if cancellation failed Raises: Exception: If cancellation fails rrzcancel crawl jobN)r_delete_requestrrrPrrrs&& r! cancel_crawlFirecrawlApp.cancel_crawl1sz'')''4<<. 2$(GQ   3 & P}}&   x); < P"MOOs A(( A5c*<V^8dQhRS[RS[S[S[,,RS[S[S[,,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,R S[S[,R S[S[,R S[S[,R S[S[S[S[3,,R S[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RR/#)r)r^rrrrrrrrrrrrrrr'rrrrr CrawlWatcher)r-rrrrrrrr)r.r/s"r!r0rJsVS9S9S9$DI. S9 $DI. S9  } S9"*#S9C=S9#+4.S9"*$S9#+4.S9%TNS9%]3S9eC$678S9'/tnS9 &.d^!S9" (~#S9$C=%S9&'tn'S9(&c])S9*"*$+S9,&c]-S90 1S9r2c $VP!V3/RVbRVbRVbRVbRVbRVbRVbRV bR V bR V bR V bR V bR VbRVbRVbRVbRVbRVbRVbVBpVP'd)VP'd\VPV4#\ R4h)ag Initiate a crawl job and return a CrawlWatcher to monitor the job via WebSocket. Args: url (str): Target URL to start crawling from include_paths (Optional[List[str]]): Patterns of URLs to include exclude_paths (Optional[List[str]]): Patterns of URLs to exclude max_depth (Optional[int]): Maximum crawl depth max_discovery_depth (Optional[int]): Maximum depth for finding new URLs limit (Optional[int]): Maximum pages to crawl allow_backward_links (Optional[bool]): DEPRECATED: Use crawl_entire_domain instead crawl_entire_domain (Optional[bool]): Follow parent directory links allow_external_links (Optional[bool]): Follow external domain links ignore_sitemap (Optional[bool]): Skip sitemap.xml processing scrape_options (Optional[ScrapeOptions]): Page scraping configuration webhook (Optional[Union[str, WebhookConfig]]): Notification webhook settings deduplicate_similar_urls (Optional[bool]): Remove similar URLs ignore_query_parameters (Optional[bool]): Ignore URL parameters regex_on_full_url (Optional[bool]): Apply regex to full URLs delay (Optional[int]): Delay in seconds between scrapes allow_subdomains (Optional[bool]): Follow subdomains max_concurrency (Optional[int]): Maximum number of concurrent scrapes zero_data_retention (Optional[bool]): Whether to delete data after 24 hours idempotency_key (Optional[str]): Unique key to prevent duplicate requests **kwargs: Additional parameters to pass to the API Returns: CrawlWatcher: An instance to monitor the crawl job via WebSocket Raises: Exception: If crawl job fails to start rrrrrrrrrrrrrrr'rrrrCrawl job failed to start)rrrr#r)rr^rrrrrrrrrrrrrrr'rrrrrcrawl_responses&&$$$$$$$$$$$$$$$$$$$, r!crawl_url_and_watch FirecrawlApp.crawl_url_and_watchJsr--  ' (   !4    "6 !4 "6 * *  &> %< 0 ! ".# $,% &!4' (,+ .  ! ! !n&7&7&7 1 148 878 8r2rinclude_subdomains sitemap_only use_indexc<V^8dQhRS[RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,R S[/ #) r)r^rrr)r*rrr+r)r-rrrrA)r.r/s"r!r0rsX0X0X0SM X0 %TN X0 !) X0#4.X0C=X0c]X0 ~X0%X0r2c VPV R4/p VeW*R&VeW:R&VeWJR&VeWZR&VeWjR&VeWzR&VeWR &V PV 4V PR 4p \R/V Bp V P R R R 7p WR &R\ 2V R&V 'dWR &\ P!VP R2RRVP 2/V R7pVP^8XdeVP4pVPR4'dRV9d \R/VB#RV9d\RVR, 24h\RV 24hVPVR4R# \d \R4hi;i)a Map and discover links from a URL. Args: url (str): Target URL to map search (Optional[str]): Filter pattern for URLs ignore_sitemap (Optional[bool]): Skip sitemap.xml processing include_subdomains (Optional[bool]): Include subdomain links sitemap_only (Optional[bool]): Only use sitemap.xml limit (Optional[int]): Maximum URLs to return timeout (Optional[int]): Request timeout in milliseconds **kwargs: Additional parameters to pass to the API Returns: MapResponse: Response containing: * success (bool): Whether request succeeded * links (List[str]): Discovered URLs * error (Optional[str]): Error message if any Raises: Exception: If mapping fails or response cannot be parsed map_urlNrr"r<r=rrr>rTrr^rrH/v1/maprrrrrbrzMap failed. Error: rmapr3)rrrr:rrrrrrrrPrArrr)rr^rrr)r*rrr+r map_paramsrrrrrs&&$$$$$$$, r!r.FirecrawlApp.map_urlsF fi0   #)x  %*8 '  ).@* +  #(4} %  "'w   $+y !  %.z " &!!~~m4 !.:. "''D'I  E"-gY 7 H )5 &==||nG $$ ~&>?    3 & O (   $$Y//G}4L&777 -#&9-:P9Q$RSS#&9-$IJJ   x / O MNN Os0&E'E')*E''E>c.<V^8dQhRS[S[,RS[S[S[R,,,RS[S[S[S[3,,RS[S[S[,,RS[S[S[,,RS[S[,RS[S[,R S[S[,R S[S[,R S[S[,R S[S[,R S[S[,RS[S[,RS[S[R,,RS[S[,RS[S[,RS[S[S[ S[ S[ S[ S[ S[S[S[S[S[3 ,,,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[/#)r)urlsrrcrtrrrrrrrrrrrrrfrrrrrr r_r`rarrbrdrrcrPrrr-rrrrrrlrrrrrrrrrrrr&r)r.r/s"r!r0rsKCKC3iKC$w(Q RST KC $sCx.) KC tCy) KCtCy)KC$D>KC3-KC#KC>*KCKC (~KC'tnKCD>KC  :;(>8{[dOeCe/3/G/G T]H^_gHh/iK "8 , K 'K ,F,F8WbcpWqKq373K3KKXeLfgoLp3qK &x 0''8%%6F&GV]^   3 & P]]_((.++BG G   x)A BC(U: P"MOOs4M& M++ M8c-<V^8dQhRS[S[,RS[S[S[R,,,RS[S[S[S[3,,RS[S[S[,,RS[S[S[,,RS[S[,RS[S[,R S[S[,R S[S[,R S[S[,R S[S[,R S[S[,RS[S[,RS[S[R,,RS[S[,RS[S[,RS[S[S[ S[ S[ S[ S[ S[S[S[S[S[3 ,,,RS[S[,RS[S[,RS[S[,RS[S[,RS[/#)r)r4rrcrtrrrrrrrrrrrrrfrrrrrr5rrr-rrrrrrlrrrrrrrrrrrr&r)r.r/s"r!r0rsJCJC3iJC$w(Q RST JC $sCx.) JC tCy) JCtCy)JC$D>JC3-JC#JC>*JCJC (~JC'tnJCD>JC  :;(>8{[dOeCe/3/G/G T]H^_gHh/iK "8 , K 'K ,F,F8WbcpWqKq373K3KKXeLfgoLp3qK &x 0''8%%6F&GV]^   3 & P*=X]]_==   x)A BA(U: P"MOOs4M  M Mc-<V^8dQhRS[S[,RS[S[S[R,,,RS[S[S[S[3,,RS[S[S[,,RS[S[S[,,RS[S[,RS[S[,R S[S[,R S[S[,R S[S[,R S[S[,R S[S[,RS[S[,RS[S[R,,RS[S[,RS[S[,RS[S[S[ S[ S[ S[ S[ S[S[S[S[S[3 ,,,RS[S[,RS[S[,RS[S[,RS[S[,RR/#)r)r4rrcrtrrrrrrrrrrrrrfrrrrrr#r5r)rr-rrrrrrlrrrrrrrrrrrr&)r.r/s"r!r0rsJCJC3iJC$w(Q RST JC $sCx.) JC tCy) JCtCy)JC$D>JC3-JC#JC>*JCJC (~JC'tnJCD>JC  :;(>8{[dOeCe/3/G/G T]H^_gHh/iK "8 , K 'K ,F,F8WbcpWqKq373K3KKXeLfgoLp3qK &x 0''8%%6F&GV]^   3 & P!4!Gx}}!G!)))n.?.?.?'(9(94@@#$FGG   x)A BI(UB P"MOOs4N UU^_jkr_s^t0u&v v"R!..@PQ 1 #&@g$PQQ""8Y7u4LMMCT#&QSS`&/2]&_ _ *SVS) ) *s[ 2I >H+I I 6>I 5H;I A?I + H88I ; II I0I++I0c6<V^8dQhRS[RS[S[,/#r)rbrr-rLr)r.r/s"r!r0rls ***1E*r2c TVP4pVPVP RV 2V4pVP^8Xd\ R/VP 4B#VPVR4R# \ R4h;i \ dp\\T4R4hRp?ii;i)z Retrieve the status of an extract job. Args: job_id (str): The ID of the extract job. Returns: ExtractResponse[Any]: The status of the extract job. Raises: ValueError: If there is an error retrieving the status. rXrzget extract statusr\Nr3) rrrrrLrPrrrr-)rrbrtrrs&& r!get_extract_statusFirecrawlApp.get_extract_statusls'') *((DLL>fX)NPWXH##s*T*=X]]_==""8-ABT#&QSS *SVS) ) *s/2BA2B2 A??B B' B""B'c<V^8dQhRS[S[S[,,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[S[S[3,,R S[S[,/ #rQrR)r.r/s"r!r0rsB*B*49%B*SM B* SM B* $C= B*#+4.B* (~B*#4.B*DcN+B*8Gs7KB*r2c  VP4p TpV'dVPV4pRVRVRVRVRVRR\ 2/p V'dW*R&V'dWJR &V'dWR &VPVP R 2W4p V P ^8Xd\ R/V P4B#VPV R 4R# \R 4h;i \dp \\T 4R4hRp ? ii;i)a4 Initiate an asynchronous extract job. Args: urls (List[str]): URLs to extract information from prompt (Optional[str]): Custom extraction prompt schema (Optional[Any]): JSON schema/Pydantic model system_prompt (Optional[str]): System context allow_external_links (Optional[bool]): Follow external links enable_web_search (Optional[bool]): Enable web search show_sources (Optional[bool]): Include source URLs agent (Optional[Dict[str, Any]]): Agent configuration idempotency_key (Optional[str]): Unique key to prevent duplicate requests Returns: ExtractResponse[Any] with: * success (bool): Whether request succeeded * data (Optional[Any]): Extracted data matching schema * error (Optional[str]): Error message if any Raises: ValueError: If job initiation fails r4r!rGrIr}rHrr+rrrVrz async extractr\Nr3) rrrrrrrLrPrrrr-) rr4r+r}rrrrrrtrarrs &&$$$$$$$ r! async_extractFirecrawlApp.async_extractsD'') --f5F D "6 0 < f  G9-   %+ " +8 ( $) ! *))T\\N+*F ^H##s*T*=X]]_==""8_=T#&QSS *SVS) ) *s0&0CC0C CC C9C44C9max_urlsshow_full_textrgexperimental_streamc ~<V^8dQhRS[RS[S[,RS[S[,RS[S[,RS[S[,RS[/#r)r^rnrorgrprr-rrrr)r.r/s"r!r0rs`CCCsm C %TN C D> C"*$C 8 "*$8 bT)JGTH##s*w ( I9FIFF%%, CDD""8-OP.eCZckwyzz!w#&lmpqrmslt$uvvw  %SV$ $ %s;2CB .C C)CCC C,C''C,cL<V^8dQhRS[S[,RS[S[S[3,/#)r)rr)rr-r)r.r/s"r!r0ros)  %c] 6:38n r2c bV'dRRRRVP 2RV/#RRRRVP 2/#)z Prepare the headers for API requests. Args: idempotency_key (Optional[str]): A unique key to ensure idempotency of requests. Returns: Dict[str, str]: The headers including content type, authorization, and optionally idempotency key. z Content-Typezapplication/jsonrrzx-idempotency-key)r)rrs&&r!rFirecrawlApp._prepare_headersosN  274<<.!9#_  . wt||n5  r2c ~<V^8dQhRS[RS[S[S[3,RS[S[S[3,RS[RS[RS[P /#r)r^rrtretriesbackoff_factorr)r-rrrrrResponse)r.r/s"r!r0rs]sCx.#s(^    "  -5,=,= r2c \V4F~p\P!YTRV9d#VR,eVR,R, ^,MRR7pVPR8Xd'\P !V^V,,4K|Vu# X#)a Make a POST request with retries. Args: url (str): The URL to send the POST request to. data (Dict[str, Any]): The JSON data to include in the POST request. headers (Dict[str, str]): The headers to include in the POST request. retries (int): Number of retries for the request. backoff_factor (float): Backoff factor for retries. Returns: requests.Response: The response from the POST request. Raises: requests.RequestException: If the request fails after the specified retries. rNrr)rangerrrr_r`)rr^rrtrrattemptrs&&&&&& r!rFirecrawlApp._post_requests.W~G}}SqzCrCHLMVHWHcPTU^P_bhPhklPlimoH##s* >Q'\:; & r2c b<V^8dQhRS[RS[S[S[3,RS[RS[RS[P /#r)r^rtrrrr-rrrrr)r.r/s"r!r0rK#s(^  "  -5,=,= r2c \V4FSp\P!WR7pVPR8Xd'\P !V^V,,4KQVu# X#)a Make a GET request with retries. Args: url (str): The URL to send the GET request to. headers (Dict[str, str]): The headers to include in the GET request. retries (int): Number of retries for the request. backoff_factor (float): Backoff factor for retries. Returns: requests.Response: The response from the GET request. Raises: requests.RequestException: If the request fails after the specified retries. rtr)rrrrr_r`rr^rtrrrrs&&&&& r!rFirecrawlApp._get_requestsO*W~G||C9H##s* >Q'\:; & r2c b<V^8dQhRS[RS[S[S[3,RS[RS[RS[P /#rr)r.r/s"r!r0rrr2c \V4FSp\P!WR7pVPR8Xd'\P !V^V,,4KQVu# X#)a Make a DELETE request with retries. Args: url (str): The URL to send the DELETE request to. headers (Dict[str, str]): The headers to include in the DELETE request. retries (int): Number of retries for the request. backoff_factor (float): Backoff factor for retries. Returns: requests.Response: The response from the DELETE request. Raises: requests.RequestException: If the request fails after the specified retries. rr)rrdeleterr_r`rs&&&&& r!rFirecrawlApp._delete_requestsO*W~GsQ'\:; & r2cH<V^8dQhRS[RS[S[S[3,RS[RS[/#r)rrtrrr-rrr0)r.r/s"r!r0rsA2J2J2J#s(^2J 2J$7 2Jr2c VP RV 2pVPWB4pVP^8XdVP4pTR,R8XdRT9dTR,pRT9df\ TR,4^8XdMMTPTR,T4pTP4pTP TPR.44KlYvR&\R /TB#\ R4hTR,R 9d&\T^4p\P!T4EK\ RTR, 24hVPVR 4EKF \ R4h;i \ R4h;i) a Monitor the status of a crawl job until completion. Args: id (str): The ID of the crawl job. headers (Dict[str, str]): The headers to include in the status check requests. poll_interval (int): Seconds between status checks. Returns: CrawlStatusResponse: The crawl results if the job is completed successfully. Raises: Exception: If the job fails or an error occurs during status checks. rrr rvrrz,Crawl job completed but no data was returnedz)Crawl job failed or was stopped. Status: rr3activepausedpendingqueuedwaitingr) rrrrPrrrrr0maxr_r`r)rrrtrrr r rs&&&& r!r FirecrawlApp._monitor_job_statussk&j5G"//AO**c1T"1"6"6"8Kx(K7,*62$ 3";v#671< %.2.?.? F@SU\.]O`.=.B.B.D !KK (CD.2F+2A[AA'(VWW *.nn"%mA"6MJJ}-#&OP[\dPeOf$ghh""?4HI1T#&QSS`&/2]&_ _sEE E E$c><V^8dQhRS[PRS[RR/#r)rrrN)rrr-)r.r/s"r!r0r s4#H#H''#H#H!#Hr2c VP4pVPRR4pVPRR4pTP TPY$T4p\PPYqR 7h TPR,pTP4'dRT 2pRTP 2pLRTP 2pR pL \ dR TP 2pR pLi;i;i) a0 Handle errors from API responses. Args: response (requests.Response): The response object from the API request. action (str): Description of the action that was being performed. Raises: Exception: An exception with a message containing the status code and error details from the response. rNo error message provided.details%No additional error details provided.:NiNz#Server returned non-JSON response: zFull response status: z+Server returned empty response with status zNo additional details availablez0Server returned unreadable response with status )r) rPrrrrr_get_error_messager exceptions HTTPError)rrrr error_message error_details response_textmessages&&& r!rFirecrawlApp._handle_error s B$MMOM)--g7STM)--i9`aM))(*>*>Wde!!++G+GG# B B ( d 3  &&((&I-$YM&O$44V&?#Y&0$Y/0A0BC )Ff%*$'y(9$:!h;. !X-"? 7@S?T UVV!\1 JJqM5'+VWWr2c<V^8dQhRS[RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[S[3,/#) r)rXrrrnrrrrr-rrrrr)r.r/s"r!r0r sEDEDED } ED ! ED sm ED&c]ED$C=ED*2$EDDHS>EDr2c /pVeW(R&VeW8R&VeWHR&VeWXR&VeWhR&VeWxR&\R/VBpVP4p RV/VPR R R 7Cp R \ 2V R &R V 9dSV R ,p V 'dBRV 9d;\ V R,R4'd"V R,P 4V R ,R&VP VP R2W4p V P^8XdV P4#VPV R4RRRR/# \R4h;i \dp \\T 44hRp ? ii;i)2 Initiates an asynchronous deep research operation. Args: query (str): Research query or topic to investigate max_depth (Optional[int]): Maximum depth of research exploration time_limit (Optional[int]): Time limit in seconds for research max_urls (Optional[int]): Maximum number of URLs to process analysis_prompt (Optional[str]): Custom prompt for analysis system_prompt (Optional[str]): Custom system prompt __experimental_stream_steps (Optional[bool]): Enable experimental streaming Returns: Dict[str, Any]: A response containing: * success (bool): Whether the research initiation was successful * id (str): The unique identifier for the research job * error (str, optional): Error message if initiation failed Raises: Exception: If the research initiation fails. NrrmrernrrrXTrrrHrr}/v1/deep-researchrzstart deep researchrFrrr3)rkrrrhasattrr}rrrrPrrrr-)rrXrrrnrrrrrtr json_optsrrs&&$$$$$$ r!r FirecrawlApp.async_deep_research s>  *3J '  !+5K (  )1I &  &0?, -  $.;N + & 2x5H5O5O5Q -(2 %))T\\N:K*LiaH##s*S#==?*""8-BC5'+BCCS#$QRR %SV$ $ %s0 0D5<D% D5% D22D55 EEEc&<V^8dQhRS[RS[/#rr-rx)r.r/s"r!r0r s (D(DS(D5O(Dr2c VP4pVPVP RV 2V4pVP^8XdVP 4#VPR8Xd \ R4hVP VR4RRR R /# \ R4h;i \ dp\\T44hRp?ii;i) g Check the status of a deep research operation. Args: id (str): The ID of the deep research operation. Returns: DeepResearchResponse containing: Status: * success - Whether research completed successfully * status - Current state (processing/completed/failed) * error - Error message if failed Results: * id - Unique identifier for the research job * data - Research findings and analysis * sources - List of discovered sources * activities - Research progress log * summaries - Generated research summaries Raises: Exception: If the status check fails. /v1/deep-research/rrzDeep research job not foundzcheck deep research statusNrFrr) rrrrrPrrrr-)rrrtrrs&& r!r'FirecrawlApp.check_deep_research_status s2'') %((DLL>9KB4)PRYZH##s*S#==?*%%, =>>""8-IJ5'+BCCS#$QRR  %SV$ $ %s/2BB .B BB B>%B99B>c@<V^8dQhRS[S[S[3,RS[RR/#)r)r method_namerNrr-r)r.r/s"r!r0r$ s/.l.ltCH~.lC.lD.lr2c $V'gR#R0RmR0RmR0RmR0RmR0RmR0RmR0RmR 0Rm/pVPV\44p\VP44V, pV'd"\R V R R P V4 R 24hR#)ah Validate additional keyword arguments before they are passed to the API. This provides early validation before the Pydantic model validation. Args: kwargs (Dict[str, Any]): Additional keyword arguments to validate method_name (str): Name of the method these kwargs are for Raises: ValueError: If kwargs contain invalid or unsupported parameters Nrrcrrr.r8r?rCzUnsupported parameter(s) for z: z, zC. Please refer to the API documentation for the correct parameters.>rrrrfrcrrrrrrrrrrrrrr> rYr[rrZrnrrrr>rrrrrrrrrrrrrr>rrrrr*rr)>rr+r}rrrrr>rrrrfrcrrtrrrrrrrrrrr)rsetkeysrr)rrr method_paramsallowed_paramsunknown_paramss&&& r!rFirecrawlApp._validate_kwargs$ s  T {  | R "@ &(F *,J% 2'**;>V[[]+n< <[MDIIVdLeKfgjkl l r2c VfV#\V\4'dE\VR4'dVP4#\VR4'dVP 4#\V\ 4'd4VP 4UUu/uFwr#W PV4bK upp#\V\\34'd!VUu.uFq0PV4NK up#V#uuppiuupi)zg Utility to ensure a schema is a dict, not a Pydantic model class. Recursively checks dicts and lists. model_json_schemar}) rrrrr}ritemsrlisttuple)rr}kvs&& r!r FirecrawlApp._ensure_schema_dictW s >M fd # #v233//11**}}& fd # #?E||~N~tqA//22~N N ftUm , ,9?@A,,Q/@ @ O@s C( C.)rrNNN?)'r4r5r6r7rrrrrrrr r'r.r8r?rCrJrNrcrhrlr}rzr{rrrrrrrrrrrrr:r;r<s@r!rrsN OO$Y7mq Y7 15 Y7 15 Y715Y715Y7'+Y7&+Y726Y7&*Y759Y748Y7)-Y7 DH!Y7")-#Y7$-1%Y7&26'Y7(sw)Y7*HL+Y7,&*-Y7..2/Y70371Y72-13Y7Y7v]3$( ]3 "& ]3 %) ]3#']3&*]3'+]3&+]37;]3]3~@<.2 @< .2 @< $( @<.2@< $@<04@</3@<04@<*.@<37@<8<@<48@< 37!@<"-1#@<$ $%@<&,0'@<(*.)@<*/3+@<,()-@<.*./@<@::2J2Jh#H#HJuu4^X(, ^X )- ^X '+ ^X.2^X,0^X;?^XGK^XEI^X^X@ED(, ED )- ED '+ ED.2ED,0ED;?EDEDN(D(DT.l.lfr2rca]tRtRtoRtV3RlRltV3RlRltV3RlRltV3R lR ltV3R lR lt V3R lRlt Rt Vt R#)r#ii a A class to watch and handle crawl job events via WebSocket connection. Attributes: id (str): The ID of the crawl job to watch app (FirecrawlApp): The FirecrawlApp instance data (List[Dict[str, Any]]): List of crawled documents/data status (str): Current status of the crawl job ws_url (str): WebSocket URL for the crawl job event_handlers (dict): Dictionary of event type to list of handler functions c&<V^8dQhRS[RS[/#r)rapp)r-r)r.r/s"r!r0CrawlWatcher.__annotate__u s   3  \  r2cWnW n.VnRVnVPP RR4 RV 2VnR.R.R./VnR#)rhttpwsrdonerdocumentN)rrrr rreplacews_urlevent_handlers)rrrs&&&r!rCrawlWatcher.__init__u sW*,   ,,VT:;:bTJ B R  r2c<V^8dQhRR/#r)rNr3)r.r/s"r!r0r s * *t *r2c B"\P!VPRRRVPP 23.R7;_uu_4GRjxL pVP V4GRjxL RRR4GRjxL R#L/LL +GRjxL 'giR#;i5i)zE Establishes WebSocket connection and starts listening for messages. Nrr)max_sizeadditional_headers websocketsconnectrrr_listenr websockets& r!rCrawlWatcher.connect s%% KK!0GDHH&B* B5B6B>BBB B  B B  Bc<V^8dQhRR/#rr3)r.r/s"r!r0r  , ,$ ,r2c "VRjxL p\P!V4pVPV4GRjxL K;L6LD9R#5i)zq Listens for incoming WebSocket messages and handles them. Args: websocket: The WebSocket connection object NrPloads_handle_messagerrrmsgs&& r!rCrawlWatcher._listen E' , ,'**W%C&&s+ + + , +'5AAAA,AAAAAAcV<V^8dQhRS[RS[S[S[S[3,.R3,RR/#)r) event_typehandlerNr)r-rrr)r.r/s"r!r0r s9 < lR?lltR.RR/RR0RR1RR2RR3RR4RR5RR6RR7RR8RR9RR:RR;RR* +4  +4"+4-1cN+4r2c "\P!4;_uu_4GRjxL p\V4FpVPWW4R7;_uu_4GRjxL p V PR8Xd@\ P !V^V,,4GRjxL RRR4GRjxL KxV PR8dVPV RV R24GRjxL V P4GRjxL uuRRR4GRjxL uuuRRR4GRjxL # \R4hELLLLLXLBL3L! +GRjxL 'giEK;i \PdIp Y^, 8XdT h\ P !T^T,,4GRjxL Rp ? EKyRp ? ii;i +GRjxL 'giR#;i5i)a Generic async request method with exponential backoff retry logic. Args: method (str): The HTTP method to use (e.g., "GET" or "POST"). url (str): The URL to send the request to. headers (Dict[str, str]): Headers to include in the request. data (Optional[Dict[str, Any]]): The JSON data to include in the request body (only for POST requests). retries (int): Maximum number of retry attempts (default: 3). backoff_factor (float): Factor to calculate delay between retries (default: 0.5). Delay will be backoff_factor * (2 ** retry_count). Returns: Dict[str, Any]: The parsed JSON response from the server. Raises: aiohttp.ClientError: If the request fails after all retries. Exception: If max retries are exceeded or other errors occur. N)rBr^rtrPri,zmake z requestzMax retries exceeded) aiohttp ClientSessionrrequestr asyncior`rrP ClientErrorr) rrBr^rtrrrsessionrrrs &&&&&&& r!_async_request AsyncFirecrawlApp._async_request s{6((***g > I&% /   !#??c1")--!w,0O"PPP$     $??c1"&"4"4Xvhh?W"XXX%-]]_4   +**)23 3!+ Q  Y4 +    **IA+-!--!w,(GHHHHI+***s?"GD&GF5ED)E9D7 D+D7  E%D- &E*F5,*D7 D/D7 .D1/D7 2 E?D3 EF5 GD5G F5&G)E+D7 -E/D7 1D7 3E5G7E=E> E E EF5EF2 *6F- F# !F- &F5-F2 2F55G ;F>< G G Gc<V^8dQhRS[RS[S[S[3,RS[S[S[3,RS[RS[RS[S[S[3,/#r)r-rrrr)r.r/s"r!r0rC s]^^^"&sCx.^;?S>^^.3^>B38n^r2c F"VPRWW$V4GRjxL #L5i)a Make an async POST request with exponential backoff retry logic. Args: url (str): The URL to send the POST request to. data (Dict[str, Any]): The JSON data to include in the request body. headers (Dict[str, str]): Headers to include in the request. retries (int): Maximum number of retry attempts (default: 3). backoff_factor (float): Factor to calculate delay between retries (default: 0.5). Delay will be backoff_factor * (2 ** retry_count). Returns: Dict[str, Any]: The parsed JSON response from the server. Raises: aiohttp.ClientError: If the request fails after all retries. Exception: If max retries are exceeded or other errors occur. POSTNrK)rr^rrtrrs&&&&&&r!_async_post_request%AsyncFirecrawlApp._async_post_request s$*((tn]]]] !!c d<V^8dQhRS[RS[S[S[3,RS[RS[RS[S[S[3,/#r)r-rrrr)r.r/s"r!r0rC sL]]]%)#s(^]].3]>B38n]r2c F"VPRWRW44GRjxL #L5i)ac Make an async GET request with exponential backoff retry logic. Args: url (str): The URL to send the GET request to. headers (Dict[str, str]): Headers to include in the request. retries (int): Maximum number of retry attempts (default: 3). backoff_factor (float): Factor to calculate delay between retries (default: 0.5). Delay will be backoff_factor * (2 ** retry_count). Returns: Dict[str, Any]: The parsed JSON response from the server. Raises: aiohttp.ClientError: If the request fails after all retries. Exception: If max retries are exceeded or other errors occur. GETNrP)rr^rtrrs&&&&&r!_async_get_request$AsyncFirecrawlApp._async_get_request s$(((dG\\\\rSc><V^8dQhRS[PRS[RR/#rrEClientResponser-)r.r/s"r!r0rC$ s)++G,B,B+C+TX+r2c R"VP4GRjxL pVPRR4pVPRR4pTP TPY$T4GRjxL p\P!T4hLc \P!RTP 24h;iLD5i)a Handle errors from async API responses with detailed error messages. Args: response (aiohttp.ClientResponse): The response object from the failed request action (str): Description of the action that was being attempted Raises: aiohttp.ClientError: With a detailed error message based on the response status: - 402: Payment Required - 408: Request Timeout - 409: Conflict - 500: Internal Server Error - Other: Unexpected error with status code Nrrrr?Failed to parse Firecrawl error response as JSON. Status code: )rPrrErIr _get_async_error_messagerrr error_datarrrs&&& r!rAsyncFirecrawlApp._handle_error$ s  {'}}.J&NN74PQM&NN96]^M55hoov^kll!!'**/ {%%(ghphwhwgx&yz zls8B'A=A;(A= B' B%!B';A==%B""B'c 8<V^8dQhRS[RS[RS[RS[RS[/#rr)r.r/s"r!r0rC? : Z Z# Zs Z[^ Zor Zwz Zr2c ."VPWW44#5ia Generate a standardized error message based on HTTP status code for async operations. Args: status_code (int): The HTTP status code from the response action (str): Description of the action that was being performed error_message (str): The error message from the API response error_details (str): Additional error details from the API response Returns: str: A formatted error message rrs&&&&&r!r^*AsyncFirecrawlApp._get_async_error_message? &&{MYYcP<V^8dQhRS[RS[S[,RS[S[,RR/#)r)r^r|rrAsyncCrawlWatcher)r-rr)r.r/s"r!r0rCN s=*9*9*9[)*9&c] *97J *9r2c "VPWV4GRjxL pVPR4'dRV9d\VR,V4#\R4hL@5i)a Initiate an async crawl job and return an AsyncCrawlWatcher to monitor progress via WebSocket. Args: url (str): Target URL to start crawling from params (Optional[CrawlParams]): See CrawlParams model for configuration: URL Discovery: * includePaths - Patterns of URLs to include * excludePaths - Patterns of URLs to exclude * maxDepth - Maximum crawl depth * maxDiscoveryDepth - Maximum depth for finding new URLs * limit - Maximum pages to crawl Link Following: * allowBackwardLinks - DEPRECATED: Use crawlEntireDomain instead * crawlEntireDomain - Follow parent directory links * allowExternalLinks - Follow external domain links * ignoreSitemap - Skip sitemap.xml processing Advanced: * scrapeOptions - Page scraping configuration * webhook - Notification webhook settings * deduplicateSimilarURLs - Remove similar URLs * ignoreQueryParameters - Ignore URL parameters * regexOnFullURL - Apply regex to full URLs idempotency_key (Optional[str]): Unique key to prevent duplicate requests Returns: AsyncCrawlWatcher: An instance to monitor the crawl job via WebSocket Raises: Exception: If crawl job fails to start Nrrr%)rrrkr)rr^r|rr&s&&&& r!r'%AsyncFirecrawlApp.crawl_url_and_watchN sYL $33CQQ   i ( (T^-C$^D%94@ @78 8 RAAA&Ac`<V^8dQhRS[S[,RS[S[,RS[S[,RR/#)r)r4r|rrrk)rr-rr)r.r/s"r!r0rCz sG(@(@s)(@\*(@&c] (@7J (@r2c "VPWV4GRjxL pVPR4'dRV9d\VR,V4#\R4hL@5i)a Initiate an async batch scrape job and return an AsyncCrawlWatcher to monitor progress. Args: urls (List[str]): List of URLs to scrape params (Optional[ScrapeParams]): See ScrapeParams model for configuration: Content Options: * formats - Content formats to retrieve * includeTags - HTML tags to include * excludeTags - HTML tags to exclude * onlyMainContent - Extract main content only Request Options: * headers - Custom HTTP headers * timeout - Request timeout (ms) * mobile - Use mobile user agent * proxy - Proxy type Extraction Options: * extract - Content extraction config * jsonOptions - JSON extraction config * actions - Actions to perform idempotency_key (Optional[str]): Unique key to prevent duplicate requests Returns: AsyncCrawlWatcher: An instance to monitor the batch scrape job via WebSocket Raises: Exception: If batch scrape job fails to start NrrrD)r?rrkr)rr4r|rbatch_responses&&&& r!rC-AsyncFirecrawlApp.batch_scrape_urls_and_watchz sYH $;;D/ZZ   i ( (T^-C$^D%94@ @>? ? [rnrrtrrrrrrrrrrrrrrcrrfrc/f<V^8dQhRS[RS[S[S[R,,,RS[S[S[S[3,,RS[S[S[,,RS[S[S[,,RS[S[,RS[S[,R S[S[,R S[S[,R S[S[,R S[S[,R S[S[,RS[S[,RS[S[R,,RS[S[,RS[S[,RS[S[,RS[S[S[ S[ S[ S[ S[ S[S[S[S[S[3 ,,,RS[S[,RS[S[,/#)r)r^rrcrtrrrrrrrrrrrrrrfrrrr)r-rrrrrrrlrrrrrrrrrrrr&rr)r.r/s"r!r0rC sHMHMHMd7,g$hij HM d38n- HM #49- HM#49-HM (~HMsmHMc]HM~.HMTNHM$,D>HM#+4.HM ~HM G$>?@!HM" ~#HM$j)%HM&#:.'HM(d55E{T_alnz}IKbdm*m$nop)HM*L)+HM,(,-HMr2c "VPVR4VP4pRVRR\ 2/pV'dVVR&V'dVVR&V'dVVR&V'dVVR&VeVVR &V'dVVR &V'dVVR &V 'dV PR R R7VR&V eV VR&V eV VR&V eV VR&V eV VR&V'dVVR&VeVVR&VexVP V4p\ V\4'd#RV9dVP VR,4VR&\ V\4'dTMVPR R R7VR&VexVP V4p\ V\4'd#RV9dVP VR,4VR&\ V\4'dTMVPR R R7VR&V'd?VUu.uF.p\ V\4'dTMVPR R R7NK0 upVR&VeVPR R R7VR&RV9dGVR,'d8RVR,9d*VP VR,R,4VR,R&RV9dGVR,'d8RVR,9d*VP VR,R,4VR,R&RpVP VP V 2VV4GR jxL pVPR4'dRV9d\R /VR,B#RV9d\RVR, 24hVPR\V44p\RV 24huupiL~5i)!a^ Scrape a single URL asynchronously. Args: url (str): Target URL to scrape formats (Optional[List[Literal["markdown", "html", "rawHtml", "content", "links", "screenshot", "screenshot@fullPage", "extract", "json"]]]): Content types to retrieve (markdown/html/etc) headers (Optional[Dict[str, str]]): Custom HTTP headers include_tags (Optional[List[str]]): HTML tags to include exclude_tags (Optional[List[str]]): HTML tags to exclude only_main_content (Optional[bool]): Extract main content only wait_for (Optional[int]): Wait for a specific element to appear timeout (Optional[int]): Request timeout (ms) location (Optional[LocationConfig]): Location configuration mobile (Optional[bool]): Use mobile user agent skip_tls_verification (Optional[bool]): Skip TLS verification remove_base64_images (Optional[bool]): Remove base64 images block_ads (Optional[bool]): Block ads proxy (Optional[Literal["basic", "stealth", "auto"]]): Proxy type (basic/stealth) extract (Optional[JsonConfig]): Content extraction settings json_options (Optional[JsonConfig]): JSON extraction settings actions (Optional[List[Union[WaitAction, ScreenshotAction, ClickAction, WriteAction, PressAction, ScrollAction, ScrapeAction, ExecuteJavascriptAction, PDFAction]]]): Actions to perform agent (Optional[AgentOptions]): Agent configuration for FIRE-1 model **kwargs: Additional parameters to pass to the API Returns: ScrapeResponse with: * success - Whether scrape was successful * markdown - Markdown content if requested * html - HTML content if requested * rawHtml - Raw HTML content if requested * links - Extracted links if requested * screenshot - Screenshot if requested * extract - Extracted data if requested * json - JSON data if requested * error - Error message if scrape failed Raises: Exception: If scraping fails rr^rHrrrtrrNrrrTrrrrrrrrr}rcrrfrrrrrrr3) rrrrrrrQrrrrr-)rr^rrtrrrrrrrrrrrrrcrrfrrrrrr r error_contents&&$$$$$$$$$$$$$$$$$$, r!rAsyncFirecrawlApp.scrape_url s~ fl3((* 3  G9- '.M) $ '.M) $ +7M- ( +7M- (  (/@M+ , '/M) $ '.M) $ (0 tRV (WM* %  &,M( # ,3HM/ 0  +2FM. /  (1M* % %*M' "  (1M* %  ..w7G'4((X-@$($<$HC3-HC#HC>*HCHC (~HC'tnHCD>HC  :;(>8{[dOeCe/3/G/G T]H^_gHh/iK "8 , K 'K ,F,F8WbcpWqKq373K3KKXeLfgoLp3qK &x 0''811||n, -     << " " P\\$'77G]SS S   x)A BC(m(  P"MOOSsQFMM7A5M-A M:A+M%M&MM M)M*M MMrc-|<V^8dQhRS[S[,RS[S[S[R,,,RS[S[S[S[3,,RS[S[S[,,RS[S[S[,,RS[S[,RS[S[,R S[S[,R S[S[,R S[S[,R S[S[,R S[S[,RS[S[,RS[S[R,,RS[S[,RS[S[,RS[S[S[ S[ S[ S[ S[ S[S[S[S[S[3 ,,,RS[S[,RS[S[,RS[S[,RS[/#)r)r4rrcrtrrrrrrrrrrrrrfrrrrr5rr=)r.r/s"r!r0rC sJIJI3iJI$w(Q RST JI $sCx.) JI tCy) JItCy)JI$D>JI3-JI#JI>*JIJI (~JI'tnJID>JI  :;(>8{[dOeCe/3/G/G T]H^_gHh/iK "8 , K 'K ,F,F8WbcpWqKq373K3KKXeLfgoLp3qK &x 0''811||n, -     << &# - P*=X]]_==$$X/GH H HE(U,  P"MOO HsWFM4M44MA>M4A M4A+M4 M  M4&M">M4M2 M4" M//M4rrrrrrrrrrrrrrr'rc(<V^8dQhRS[RS[S[S[,,RS[S[S[,,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,R S[S[,R S[S[,R S[S[,R S[S[S[S[3,,R S[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[/#r)r^rrrrrrrrrrrrrrr'rrrrr)r.r/s"r!r0rCE s]uBuB uB S * uB  S * uB C= uB&c]uB}uB'tnuB&d^uB'tnuB!uB!/uB%] 234uB#+4.uB "*$!uB"$D>#uB$}%uB&#4.'uB( })uB*"#+uB. /uBr2c T"VPVR4/pVeVVR&VeVVR&VeVVR&VeVVR&VeVVR&VeVVR&M VeVVR &V eV VR &V eV VR &V eV PR R R 7VR&V eV VR&V eV VR&VeVVR&VeVVR&VeVVR&VeVVR&VPV4\R/VBpVPR R R 7pVVR&R\ 2VR&VP V4pVP VP R2VV4GRjxL pVPR4'd.VPR4pTPTTT4GRjxL #VPVR4GRjxL R#Ld \R4h;iL2L5i)a Crawl a website starting from a URL. Args: url (str): Target URL to start crawling from include_paths (Optional[List[str]]): Patterns of URLs to include exclude_paths (Optional[List[str]]): Patterns of URLs to exclude max_depth (Optional[int]): Maximum crawl depth max_discovery_depth (Optional[int]): Maximum depth for finding new URLs limit (Optional[int]): Maximum pages to crawl allow_backward_links (Optional[bool]): DEPRECATED: Use crawl_entire_domain instead crawl_entire_domain (Optional[bool]): Follow parent directory links allow_external_links (Optional[bool]): Follow external domain links ignore_sitemap (Optional[bool]): Skip sitemap.xml processing scrape_options (Optional[ScrapeOptions]): Page scraping configuration webhook (Optional[Union[str, WebhookConfig]]): Notification webhook settings deduplicate_similar_urls (Optional[bool]): Remove similar URLs ignore_query_parameters (Optional[bool]): Ignore URL parameters regex_on_full_url (Optional[bool]): Apply regex to full URLs delay (Optional[int]): Delay in seconds between scrapes allow_subdomains (Optional[bool]): Follow subdomains poll_interval (Optional[int]): Seconds between status checks (default: 2) idempotency_key (Optional[str]): Unique key to prevent duplicate requests **kwargs: Additional parameters to pass to the API Returns: CrawlStatusResponse with: * Crawling status and progress * Crawled page contents * Success/error information Raises: Exception: If crawl fails rNrrrrrr rr!r"Trr#rr$r%r&r'r)r^rrHrrrrrr3) rrrrrrrQrrrryr)rr^rrrrrrrrrrrrrrr'rrrrrrrrtrrs&&$$$$$$$$$$$$$$$$$$, r!rAsyncFirecrawlApp.crawl_urlE s3v fk2   $+8L (  $+8L (  '0L $  *0CL, -  $)L !  *0CL, - ! -1EL- .  +1EL- .  %,:L )  %,:,?,?\`,?,aL )  &-L # # /5ML1 2 " .4KL0 1  (->L) *  $)L !  '.>L* + F##2\2 "''D'I  E"-gY 7 H''811 \\N) $k7<< << " " P\\$'77G]SS S$$X/@A A A<  P"MOOS AsHD+F(-F.F( FF(1F$2F( F& F( F!!F(&F(c(<V^8dQhRS[RS[S[S[,,RS[S[S[,,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,R S[S[,R S[S[,R S[S[,R S[S[S[S[3,,R S[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[/#rr)r.r/s"r!r0rC s]sBsB sB S * sB  S * sB C= sB&c]sB}sB'tnsB&d^sB'tnsB!sB!/sB%] 234sB#+4.sB "*$!sB"$D>#sB$}%sB&#4.'sB( })sB*"#+sB. /sBr2c "/pVeVVR&VeVVR&VeVVR&VeVVR&VeVVR&VeVVR&M VeVVR&V eV VR &V eV VR &V eV PR R R 7VR &V eV VR&V eV VR&VeVVR&VeVVR&VeVVR&VeVVR&VPV4\R/VBpVPR R R 7pVVR&R\ 2VR&VP V4pVP VP R2VV4GRjxL pVPR4'd \R/VB#VPVR4GRjxL R#LC \R4h;iL5i)a Start an asynchronous crawl job. Args: url (str): Target URL to start crawling from include_paths (Optional[List[str]]): Patterns of URLs to include exclude_paths (Optional[List[str]]): Patterns of URLs to exclude max_depth (Optional[int]): Maximum crawl depth max_discovery_depth (Optional[int]): Maximum depth for finding new URLs limit (Optional[int]): Maximum pages to crawl allow_backward_links (Optional[bool]): DEPRECATED: Use crawl_entire_domain instead crawl_entire_domain (Optional[bool]): Follow parent directory links allow_external_links (Optional[bool]): Follow external domain links ignore_sitemap (Optional[bool]): Skip sitemap.xml processing scrape_options (Optional[ScrapeOptions]): Page scraping configuration webhook (Optional[Union[str, WebhookConfig]]): Notification webhook settings deduplicate_similar_urls (Optional[bool]): Remove similar URLs ignore_query_parameters (Optional[bool]): Ignore URL parameters regex_on_full_url (Optional[bool]): Apply regex to full URLs idempotency_key (Optional[str]): Unique key to prevent duplicate requests **kwargs: Additional parameters to pass to the API Returns: CrawlResponse with: * success - Whether crawl started successfully * id - Unique identifier for the crawl job * url - Status check URL for the crawl * error - Error message if start failed Raises: Exception: If crawl initiation fails Nrrrrrr rr!r"Trr#rr$r%r&r'r)r^rrHrrrrr3) rrrrrrQrrr,rr)rr^rrrrrrrrrrrrrrr'rrrrrrrrtrs&&$$$$$$$$$$$$$$$$$$, r!r!AsyncFirecrawlApp.async_crawl_url s p   $+8L (  $+8L (  '0L $  *0CL, -  $)L !  *0CL, - ! -1EL- .  +1EL- .  %,:L )  %,:,?,?\`,?,aL )  &-L # # /5ML1 2 " .4KL0 1  (->L) *  $)L !  '.>L* + F##2\2 "''D'I  E"-gY 7 H''811 \\N) $     << " " P$0x00$$X/@A A A  P"MOO As6DE3EE38 E!E3E1E3! E..E3c&<V^8dQhRS[RS[/#rr)r.r/s"r!r0rC2s @@3@3F@r2c \"VP4pRV 2pVPVP V 2V4GRjxL pVPR4R8XdRV9dVR,pRV9d\ VR,4^8XdMmVPR4pV'g\ P R4M>VPWb4GRjxL pVPVPR.44TpKWTR&\VPR4VPR4VPR4VPR 4VPR 4VPR4R V9dR MR R7pR V9dVPR 4Vn RV9dVPR4Vn V#ELlL5i)a Check the status and results of an asynchronous crawl job. Args: id (str): Unique identifier for the crawl job Returns: CrawlStatusResponse containing: Status Information: * status - Current state (scraping/completed/failed/cancelled) * completed - Number of pages crawled * total - Total pages to crawl * creditsUsed - API credits consumed * expiresAt - Data expiration timestamp Results: * data - List of crawled documents * next - URL for next page of results (if paginated) * success - Whether status check succeeded * error - Error message if failed Raises: Exception: If status check fails rNr rvrrrr r rrFT)r r rvr rrr) rrWrrrrrrr0rr rrrtr r rr rrs && r!r$AsyncFirecrawlApp.check_crawl_status2s2'')t$ 33||nXJ '   ??8 $ 3$"6* +;v./14*v6H#'HI&*&=&=h&P PIKK fb 9:"+K&*F#&??8,//'*!ook2# 6!ook2($ 3E  k !(__W5HN [ 'OOF3HMI !Qs)9F,F'A!F,*F,F* CF,*F,cH<V^8dQhRS[RS[S[S[3,RS[RS[/#rr)r.r/s"r!r0rCts9)_)_#)_S#X)__b)_k~)_r2c "VPVP RV 2V4GRjxL pVPR4R8XdRV9dVR,pRV9d\VR,4^8XdMmVPR4pV'g\P R4M>VPWb4GRjxL pVP VPR.44TpKWTR&\R /VB#\R4hVPR4R 9d,\P!\V^44GRjxL EK7\R VR, 24hEL'LL!5i) a Monitor the status of an asynchronous job until completion. Args: id (str): The ID of the job to monitor headers (Dict[str, str]): Headers to include in status check requests poll_interval (int): Seconds between status checks (default: 2) Returns: CrawlStatusResponse: The job results if completed successfully Raises: Exception: If the job fails or an error occurs during status checks rNr rvrrrz&Job completed but no data was returnedz#Job failed or was stopped. Status: r3r) rWrrrrrrr0rrHr`r)rrrtrr rr rs&&&& r!ry+AsyncFirecrawlApp._async_monitor_job_statusts= $ 7 7<<. 2$/!K x(K7[(&v.D K/{623q8!#.??6#:'"NN+LM!*.*A*A(*T$T  IMM&"$=>&/ *.'.===#$LMM*.nnmmC q$9:::"EkRZF[E\ ]^^3%U;s;&EEA!E *E5E6A"/p V'd#V PVPRRR74VeW)R&VeW9R&VeWIR&VeWYR&VeWiR&VeWyR &\R/V Bp V PRRR7p WR &R \ 2V R &R p VP VP V 2V RRVP 2/R7GRjxL p V PR4'dRV 9d \R/V B#RV 9d\RV R, 24h\RV 24hLW5i)a Asynchronously map and discover links from a URL. Args: url (str): Target URL to map params (Optional[MapParams]): See MapParams model: Discovery Options: * search - Filter pattern for URLs * ignoreSitemap - Skip sitemap.xml * includeSubdomains - Include subdomain links * sitemapOnly - Only use sitemap.xml Limits: * limit - Max URLs to return * timeout - Request timeout (ms) Returns: MapResponse with: * Discovered URLs * Success/error status Raises: Exception: If mapping fails TrNrr"r<r=rrr^rrHr/rrrrrbrzFailed to map URL. Error: r3) rrr:rrQrrrrAr)rr^rrr)r*rrr|r1rrr rs&&$$$$$$$ r!r.AsyncFirecrawlApp.map_urlseF    fkk4dkK L  #)x  %*8 '  ).@* +  #(4} %  "'w   $+y !!.:. "''D'I  E"-gY 7 H11||nXJ ' $ ~&>?2   << " "w(':** *  8'9J8KLM M8 CD D sCDDD=Dr+r}rFrrc<V^8dQhRS[S[S[,,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[S[S[3,,R S[S[,/ #rQrR)r.r/s"r!r0rCsWRWR49%WRSM WR SM WR $C= WR#+4.WR (~WR#4.WRDcN+WR8Gs7KWRr2c "VP4p V'gV'g \R4hV'gV'g \R4hV'dVPV4pRT;'g.RVRVRVRVRR \4 2/p V'dW*R &V'dWJR &V'dWR &VP VP R 2V V 4GRjxL p V P R4'dV P R4p V 'g \R4hVPVP RV 2V 4GRjxL p V R,R8Xd \R/V B#V R,R9d \RV R, RV R, 24h\P!^4GRjxL K\RV P R4 24hLLL'5i)a Asynchronously extract structured information from URLs. Args: urls (Optional[List[str]]): URLs to extract from prompt (Optional[str]): Custom extraction prompt schema (Optional[Any]): JSON schema/Pydantic model system_prompt (Optional[str]): System context allow_external_links (Optional[bool]): Follow external links enable_web_search (Optional[bool]): Enable web search show_sources (Optional[bool]): Include source URLs agent (Optional[Dict[str, Any]]): Agent configuration Returns: ExtractResponse with: * Structured data matching schema * Source information if requested * Success/error status Raises: ValueError: If prompt/schema missing or extraction fails rTrUr4r!rGrIr}rHrr+rrrVNrrrWrXr rvrYrZrr[r3r^) rrrr"rQrrrrWrLrHr`)rr4r+r}rrrrrrtrarrbr s&&$$$$$$$ r!rcAsyncFirecrawlApp.extractsD'')fBC CF@A A --f5F DJJB "6 0 < f  KM?3   %+ " +8 ( $) !11||nK (     << " "\\$'F KLL$($;$;||nL9% x(K7*9[99 *.EE#l;x3H2IS^_fSgRh$ijjmmA&&&8g9N8OPQ Q1 'si F?F?F?F?F?,,F? F?%'F? F9 F?(F?0F?1F;2A#F?F=$F?;F?=F?c&<V^8dQhRS[RS[/#rrG)r.r/s"r!r0rCBs B B #B :SB r2c 0"VP4pRV 2pVPVP V 2V4GRjxL pVR,R8XdRV9dVR,pRV9d\VR,4^8XdMmVP R4pV'g\ P R4M>VPWb4GRjxL pVPVP R.44TpKWTR&\VP R4VP R4VP R4VP R 4VP R 4VP R4R 7pR V9d VR ,VR &RV9d VR,VR&R R V9dR/VC#R/VC#ELVL5i)a Check the status of an asynchronous batch scrape job. Args: id (str): The ID of the batch scrape job Returns: BatchScrapeStatusResponse containing: Status Information: * status - Current state (scraping/completed/failed/cancelled) * completed - Number of URLs scraped * total - Total URLs to scrape * creditsUsed - API credits consumed * expiresAt - Data expiration timestamp Results: * data - List of scraped documents * next - URL for next page of results (if paginated) * success - Whether status check succeeded * error - Error message if failed Raises: Exception: If status check fails rINr rvrrrr r r)r r rvr rrrrFT) rrWrrrrrrrrs && r!rJ+AsyncFirecrawlApp.check_batch_scrape_statusBs2'')&rd+ 33||nXJ '   x K /$"6* +;v./14*v6H#'HI&*&=&=h&P PIKK fb 9:"+K&*F#,??8,//'*!ook2# 6!ook2(   k ! +G 4HW  [ *62HV  ; 6u   <@   G !Qs)9FFAF*FFCFFc&<V^8dQhRS[RS[/#rr)r.r/s"r!r0rCs  # :M r2c "VP4pVPVP RV R2V4GRjxL #L5i)a Get information about errors from an asynchronous batch scrape job. Args: id (str): The ID of the batch scrape job Returns: CrawlErrorsResponse containing: errors (List[Dict[str, str]]): List of errors with fields: * id (str): Error ID * timestamp (str): When the error occurred * url (str): URL that caused the error * error (str): Error message * robotsBlocked (List[str]): List of URLs blocked by robots.txt Raises: Exception: If error check fails rIrNrrWrrrrts&& r!rN+AsyncFirecrawlApp.check_batch_scrape_errorssJ&''),,||n-bT 9     6?=?c&<V^8dQhRS[RS[/#rr)r.r/s"r!r0rCs  3 3F r2c "VP4pVPVP RV R2V4GRjxL #L5i)a Get information about errors from an asynchronous crawl job. Args: id (str): The ID of the crawl job Returns: CrawlErrorsResponse containing: * errors (List[Dict[str, str]]): List of errors with fields: - id (str): Error ID - timestamp (str): When the error occurred - url (str): URL that caused the error - error (str): Error message * robotsBlocked (List[str]): List of URLs blocked by robots.txt Raises: Exception: If error check fails rrNrrs&& r!r$AsyncFirecrawlApp.check_crawl_errorssI&''),,||nJrd' 2     rc<<V^8dQhRS[RS[S[S[3,/#rr)r.r/s"r!r0rCs#--S-T#s(^-r2c "VP4p\P!4;_uu_4GRjxL pVPVP RV 2VR7;_uu_4GRjxL pVP 4GRjxL uuRRR4GRjxL uuRRR4GRjxL #LsLBL,LL +GRjxL 'giM;iRRR4GRjxL R# +GRjxL 'giR#;i5i)rNrr)rrErFrrrP)rrrtrJrs&& r!r AsyncFirecrawlApp.cancel_crawls'')((***g~~j&Ew~WWW[c%]]_,XWW+**W,X+WWWW+*****s2C>B(C>/C!'B* (C!+B2 ?B, B2  C!B. C! C>"B0#C>*C!,B2 .C!0C>2C 8B;9 C C C! C>CC>!C; 'C*( C; 3C; 5 C>c6<V^8dQhRS[RS[S[,/#rerf)r.r/s"r!r0rCs %%s%s7K%r2c "VP4pVPVP RV 2V4GRjxL #L \dp\ \ T44hRp?ii;i5i)a Check the status of an asynchronous extraction job. Args: job_id (str): The ID of the extraction job Returns: ExtractResponse[Any] with: * success (bool): Whether request succeeded * data (Optional[Any]): Extracted data matching schema * error (Optional[str]): Error message if any * warning (Optional[str]): Warning message if any * sources (Optional[List[str]]): Source URLs if requested Raises: ValueError: If status check fails rXNrrWrrrr-)rrbrtrs&& r!rh$AsyncFirecrawlApp.get_extract_statussl$'') %00<<. VH5  %SV$ $ %1A&$?=?A&? A# AA##A&c<V^8dQhRS[S[S[,,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[S[S[3,,R S[S[,/ #rQrR)r.r/s"r!r0rCsD%D%49%D%SM D% SM D% $C= D%#+4.D% (~D%#4.D%DcN+D%8Gs7KD%r2c "VP4p V'gV'g \R4hV'gV'g \R4hV'dVPV4p\T;'g.VVVVR\ 2R7p V'dW*R&V'dWJR&V'dWR&VP VP R2V V 4GR jxL #L \dp \\T 44hR p ? ii;i5i) aT Initiate an asynchronous extraction job without waiting for completion. Args: urls (Optional[List[str]]): URLs to extract from prompt (Optional[str]): Custom extraction prompt schema (Optional[Any]): JSON schema/Pydantic model system_prompt (Optional[str]): System context allow_external_links (Optional[bool]): Follow external links enable_web_search (Optional[bool]): Enable web search show_sources (Optional[bool]): Include source URLs agent (Optional[Dict[str, Any]]): Agent configuration idempotency_key (Optional[str]): Unique key to prevent duplicate requests Returns: ExtractResponse[Any] with: * success (bool): Whether request succeeded * data (Optional[Any]): Extracted data matching schema * error (Optional[str]): Error message if any Raises: ValueError: If job initiation fails rTrUr)r4r!rGrIr}rHr+rrrVN) rrrrLrrQrrr-) rr4r+r}rrrrrrtrars &&$$$$$$$ r!rlAsyncFirecrawlApp.async_extractsD'')fBC CF@A A --f5F&3-$  *   %+ " +8 ( $) ! %11<<. ,   %SV$ $ %sh C:C:C:C:C:0C: C: C:$C:)#C C CC:C C7C22C77C:rnrorpc h<V^8dQhRS[RS[S[,RS[S[,RS[S[,RS[/#)r)r^rnrorprrs)r.r/s"r!r0rC-sQ;v;v;vsm ;v %TN ;v "*$ ;v "  *.A* +66 ) 3 7   ||I&&$h*>O$??GGFh;. !X-"EfjjQXFYEZ [\\!\1--" " "-eCtuu- H #s:3C:C4C:'C:8C69A'C: C8!C:6C:8C:rgc ~<V^8dQhRS[RS[S[,RS[S[,RS[S[,RS[S[,RS[/#rrr)r.r/s"r!r0rCjsX5%5%5%sm 5% %TN 5% D> 5%"*$5% "  *.A* +''"5  '')CQ6;;4;#PQ +G95 ( %11<<. ,   %SV$ $ %s<AB1 #B BB B1B B.B))B..B1c&<V^8dQhRS[RS[/#rr)r.r/s"r!r0rCs%%%@^%r2c "VP4pVPVP RV 2V4GRjxL #L \dp\ \ T44hRp?ii;i5i)a Check the status of an asynchronous LLMs.txt generation job. Args: id (str): The ID of the generation job Returns: GenerateLLMsTextStatusResponse containing: * success (bool): Whether generation completed successfully * status (str): Status of generation (processing/completed/failed) * data (Dict[str, str], optional): Generated text with fields: - llmstxt (str): Generated LLMs.txt content - llmsfulltxt (str, optional): Full version if requested * error (str, optional): Error message if generation failed * expiresAt (str): When the generated data expires Raises: ValueError: If status check fails rNrrrrtrs&& r!r{1AsyncFirecrawlApp.check_generate_llms_text_statussl('') %00<<. RD1  %SV$ $ %rrr-_AsyncFirecrawlApp__experimental_stream_stepsrrc.<V^8dQhRS[RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[S[S[S[3,.R 3,,R S[S[S[S[S[3,.R 3,,R S[/ #) r)rXrrrnrrrrNrrr)r.r/s"r!r0rCs^l^l^l } ^l ! ^l sm ^l&c]^l$C=^l*2$^l"(DcN+;T+A"BC^l $sCx.)94)? @A^lNh^lr2c F"/p VeW*R&VeW:R&VeWJR&VeWZR&VeWjR&VeWzR&\R/V Bp VPVVVVVVR7GRjxL p V PR 4'dR V 9dV #V R ,p ^p ^pVPV 4GRjxL pV'd7R V9d0VR ,V RpVF pV!V4K \ VR ,4p V 'd7R V9d0VR ,VRpVF pV !V4K \ VR ,4pVR ,R8XdV#VR ,R8Xd\ RVPR4 24hVR ,R8wdM!\ P!^4GRjxL EK\RRR7#EL@LL5i)rNrrmrernrrrrrr{rNr rvrwrrrPFrr]r3) rkrrrrrrHr`rx)rrXrrrnrrrrrrrrbrrr rrrrs&&$$$$$$$$ r!rAsyncFirecrawlApp.deep_researchsP  *3J '  !+5K (  )1I &  &0?, -  $.;N + & 2O$::6BBF|v5!' !56I6J!K .H)!/&)&*>&?#Y&0$Y/0A0BC )Ff%*$'y(9$:!h;. !X-"? 7@S?T UVV!\1--" " ")%?jkkO C* #sIAF!FF!6+F!!F" F!.=F!,BF!FF!F!F!c<V^8dQhRS[RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[,RS[S[S[3,/#) r)rXrrrnrrrrr)r.r/s"r!r0rCs}:%:%:% } :% ! :% sm :%&c]:%$C=:%*2$:%DHS>:%r2c "/pVeW(R&VeW8R&VeWHR&VeWXR&VeWhR&VeWxR&\R/VBpVP4p RV/VPR R R 7Cp R \ 2V R &VP VP R 2V V 4GRjxL #L \ dp \\T 44hRp ? ii;i5i)rNrrmrernrrrXTrrrHrr3) rkrrrrQrrrr-) rrXrrrnrrrrrtrrs &&$$$$$$ r!r%AsyncFirecrawlApp.async_deep_researchs>  *3J '  !+5K (  )1I &  &0?, -  $.;N + & 2<#?@AN (N r2c  B"/p V 'dK\V \4'dV PV 4M"V PV PRRR74VeW,R&VeWc><V^8dQhRS[PRS[RR/#rrZ)r.r/s"r!r0rs)++G,B,B+C+TX+r2c f"VP4GRjxL pVPRR4pVPRR4pTP P TPY$T4GRjxL p\P!T4hLm \P!RTP 24h;iLD5i)z) Handle errors from async API responses. Nrrrrr])rPrrErIr rr^r_s&&& r!rAsyncCrawlWatcher._handle_errors {'}}.J&NN74PQM&NN96]^M 99(//6bopp!!'**/ {%%(ghphwhwgx&yz zqs8B1BB(B*B1*B/+B1B%B,,B1c 8<V^8dQhRS[RS[RS[RS[RS[/#rr)r.r/s"r!r0rrcr2c ."VPWW44#5irerfrs&&&&&r!r^*AsyncCrawlWatcher._get_async_error_messagerhri)r )r4r5r6r7r8rrrr"rr^r:r; __classcell__)rr/s@@r!rkrksP""** , ,RR,++ Z Z Zr2rkcTV^8dQh/^\9d\P;R&#)r)r)__conditional_annotations__loggingLogger)r.s"r!r0r0s$  R988S r2)Mrr8rrr_typingrrrrrrrr r rPr rwarningsrrZrrErHr r"r getLoggerrr$ BaseModelr&r>rHrOr\rlrrr|rrrrrrrrrrrrrrrrrr,r0r4r:rArErLrSr^rcrkrrrxrrrrr#r@rkr0)rs@r!rs  XXX    -!++K88 CLJ!8%%! ((,,(H&& C++C8**GAJ8 *X''* UH&&UH..$H&&$(#### "x))" ($$ ($$  ($$ #8%%# 8%%h00 """"(8%%()##),=, &q)71: ,(,,, " 2 2 "+($$+( H&&  "(,, "(,, $""$ ($$ 2H&& 2 -h(('!* - 28%% 2 X'' 1X//1 6++ 6 8--  !3!3  x11 &););&X%7%7 X''  +H&& +q"q"fEYRYRvF F P8OZ OZr2