RjXdZddlmZddlZddlZddlZddlmZmZm Z m Z ddl m Z ddl mZmZmZejeZdZdZd Zejd ejZdd ZddZGdde ZdS)uxAI Web Search — plugin form. Routes ``web_search`` tool calls through xAI's agentic Web Search tool (server-side ``web_search`` on the Responses API). Grok runs the actual searching and page-browsing server-side; we ask it to return the top results as structured JSON so we can hand back the same ``{title, url, description, position}`` rows every other Hermes web provider produces. Reference: https://docs.x.ai/developers/tools/web-search Config keys this provider responds to:: web: search_backend: "xai" # explicit per-capability backend: "xai" # shared fallback Optional knobs (under ``web.xai`` in ``config.yaml``):: web: xai: model: "grok-4.3" # reasoning model required by web_search allowed_domains: ["x.ai"] # max 5 — mutually exclusive with excluded_domains excluded_domains: ["bad.com"] # max 5 — mutually exclusive with allowed_domains timeout: 90 # seconds (default 90) Auth: reuses :func:`tools.xai_http.resolve_xai_http_credentials`, which prefers Hermes-managed xAI Grok OAuth (via ``hermes auth``) and falls back to ``XAI_API_KEY`` (resolved through ``~/.hermes/.env``, then ``os.environ``). ) annotationsN)AnyDictListOptional)WebSearchProvider)has_xai_credentialshermes_xai_user_agentresolve_xai_http_credentialszgrok-4.3Zz \{[\s\S]*\}returnDict[str, Any]cn ddlm}|}t|tr|dnd}t|tr|dnd}t|tr|niS#t $r'}t d|icYd}~Sd}~wwxYw)z7Read ``web.xai`` from config.yaml (returns {} on miss).r) load_configwebNxaiz!Could not load web.xai config: %s)hermes_cli.configr isinstancedictget Exceptionloggerdebug)rcfg web_section xai_sectionexcs =/home/ubuntu/.hermes/hermes-agent/plugins/web/xai/provider.py_load_xai_web_configr @s 111111kmm(23(=(=Gcggennn4 0:;0M0MWkooe,,,SW (d;;C{{C  8#>>> sBB B4 B/)B4/B4valuer List[str]ct|tsgSg}|D]l}t|tr;|r'||t |t krnm|S)zzExecute a Grok-backed web search. Returns ``{"success": True, "data": {"web": [{title, url, description, position}, ...]}}`` on success, ``{"success": False, "error": str}`` on failure. r)is_interruptedF Interrupted)successerrorapi_keybase_urlzhttps://api.x.ai/v1/z_No xAI credentials found. Run `hermes auth` to sign in with xAI Grok OAuth, or set XAI_API_KEY.r dmodeltimeoutallowed_domainsexcluded_domainszZweb.xai.allowed_domains and web.xai.excluded_domains cannot both be set (xAI restriction).type web_searchfiltersuser)rolecontentno_inline_citations)rMinputtoolsincludezBearer zapplication/json) Authorizationz Content-Typez User-AgentNz4httpx is not installed (required for xAI web search)z0xAI web search via %s: '%s' (limit=%d, model=%s)providerz xai-oauthz /responses)headersjsonrNizQxAI web search got 401 on first attempt; forcing OAuth refresh and retrying once.T) force_refreshr[z1xAI web search OAuth refresh after 401 failed: %si,zxAI web search HTTP %d: %szxAI web search returned HTTP z: z xAI web search request error: %szCould not reach xAI: z#xAI web search produced no responsezxAI web search bad JSON: %sz/Could not parse xAI Responses API reply as JSONrFmessagecodez unknown errorz*xAI web search returned error envelope: %szxAI returned an error: r@r)rEdata)%tools.interruptrCrr r%rr&rstriprA TypeError ValueErrormaxminr r DEFAULT_MODELfloatDEFAULT_TIMEOUTr, _build_promptr httpx ImportErrorrinforangepostraise_for_statusHTTPStatusErrorresponse status_codewarningtext RequestErrorr_r_extract_results)r3r?r@rCcredsrGrIrrMrNallowedexcludedweb_search_toolpromptpayloadr^ro is_oauth_pathrespattemptrstatus refreshed refreshed_key refresh_excbodyrd api_errorerr_msg web_resultss rsearchzXAIWebSearchProvider.searchs   6 6 6 6 6 6~ B#(=AAA B    D -..eii **0b117799uyy,,E0EFFLLNNUUVYZZ  :  JJEE:&   EEE As5#''"$$$.swww/?/?$E$EX   = . &CGGI??@@GG:& & & &%GGG &&cgg.?&@&@AA&sww/A'B'BCC  x !< ,2<*@  H*;W)EOI & &  H* eUE   :..+= Qxx+ R+ RG* Rzz+++# # " %%'''(   58\5M11STS==W\\m\KK5 $@t$T$T$T (+IMM),D,D,J(K(K(Q(Q(S(S (%]g-E-E&3G7J7J7JGO4$HHHH%O' 69l6N3<,TcT22TVDD DDD;VTJJJ$MVMMtMMTTVV% R R RA3GGG#(3P33P3PQQQQQQQQQQ R <$/TUU U 99;;DD    NN8# > > > J       *4D$)?)?IDHHW%%%T i & & T i((#==((#"  NNG Q Q Q$/R/R/RSS S++D+>>  : $eR[99 9%)=>>>s %%=C C#"C#2(FF65F6II-,I-<0K// Q7:=P;8ANP; O O;P;OP; O)(P;) O85P;7O88;P;3Q7; Q7"Q2*Q72Q7R S !SS S cd|d|S)a7Compose the prompt that asks Grok to act as a search engine. We deliberately ask for a JSON object (not bare array) so we can match it cheaply with ``_JSON_BLOCK_RE``; we explicitly forbid prose, markdown fences, and inline-citation links to keep the payload parseable. u<Use the web_search tool to find current information for the query below, then respond with ONLY a single JSON object — no prose, no markdown fences, no inline citation links — matching this exact schema: {"results": [{"title": "string", "url": "string", "description": "1-2 sentence summary"}]} Return at most zy results, ordered by relevance, with absolute https:// URLs. If no usable results exist, return {"results": []}. Query: r1)r?r@s rrnz"XAIWebSearchProvider._build_promptSs*  $      r- response_dataList[Dict[str, Any]]cz||\}}|D]}|||}|r|cS |r1d|}||||}|r|S|dpg} t | t r!dt| d|DSgS)u<Pull a ``[{title, url, description, position}, ...]`` list out of a Responses-API reply. Strategy: 1. Walk ``output[*].content[*].text`` for ``output_text`` blocks and try to parse the first JSON object that has a ``results`` list. 2. If the JSON path fails, fall back to the message annotations (``url_citation`` entries) — every annotation carries a URL and a ``title`` (citation number); we pair those URLs with surrounding text from the message body as a best-effort description. rc citationscg|]E\}}t|t|.dt|d|dzdFS)rHrKtitleurl descriptionposition)rr%r&).0ius r z9XAIWebSearchProvider._extract_results..sm   Aqa%% +,'')) q66#% !A    r-N)_collect_output_text_try_parse_json_resultsjoin_results_from_annotationsrrr$ enumerate) clsrr@ text_blocksrblockparsed joined_textannotation_resultsrs rr{z%XAIWebSearchProvider._extract_resultshs&$'#;#;M#J#J [!  E00e0DDF     *))K00K!$!>!>["?"" " *))"%%k228b i & &   &i&788     r-&tuple[List[str], List[Dict[str, Any]]]cg}g}|d}t|ts||fS|D]8}t|tr|ddkr2|d}t|ts]|D]}t|tr|ddkr1|d}t|tr)|r|||d}t|tr*|D]'} t| tr|j| (ِ:||fS)zEReturn (text_blocks, annotations) extracted from ``response.output``.outputrQrarV output_textryr)rrr$rr%r&r') rrrrr+rVchunkrychunk_annotationsanns rrz)XAIWebSearchProvider._collect_output_texts "$ ,. ""8,,&$'' , + + 4 4DdD)) TXXf-=-=-J-Jhhy))Ggt,,  4 4!%..%))F2C2C}2T2Tyy((dC((-TZZ\\-&&t,,,$)IIm$<$<!/664044%c4004.K.s333 4K''r-ryOptional[List[Dict[str, Any]]]c |g}t|}|rA|d|kr(||d|D]i} t j|}n#tjtf$rY1wxYwt|tsK| d}t|tsvg}|d|D]}t|tst| dd } | sP|t| dd | t| dd t|dzd |r|cSkdS) aRParse a JSON object with a ``results`` array out of ``text``. Returns the normalized result list on success, ``None`` when the block has no valid JSON object or no ``results`` key. Tolerates leading/trailing prose because reasoning models sometimes prefix a short narration even when told not to. rresultsNrrHrrrKr)_JSON_BLOCK_RErgroupr'r_loadsJSONDecodeErrorrhrrrr$r%r&r() ryr@ candidatesmatch candidaterr normalizedrowrs rrz,XAIWebSearchProvider._try_parse_json_resultssV %%d++  .U[[^^t++   ekk!nn - - -# " "I I..(*5    fd++ jj++Ggt,, /1Jvv  !#t,,#''%,,--3355!!!$SWWWb%9%9!:!:!@!@!B!B"'*377="+E+E'F'F'L'L'N'N%( OOa$7     "!!!! "ts'A<<BBrrc 8t}g}|D]}|ddkrt|dd}|r||vrY||d}|d}|d} t |t rt | t rd|cxkr| cxkrt|krann^td|dz } || |}t|dkr|d d }| d||t|d zd t||krn|S) a Best-effort fallback when JSON parsing fails. Uses each ``url_citation`` annotation's ``url`` (the citation title is just the integer label, so we don't surface it) and slices ~200 characters of surrounding text as the description. rQ url_citationrrH start_index end_indexri8NrKr) setrr%r&addrrAr(rir') rrr@seenrrrrstartend window_starts rrz.XAIWebSearchProvider._results_from_annotationss(*  Cwwv.00cggeR(())//11C #++ HHSMMMKGGM**E''+&&C%%% =*S#*>*> =1CgCgCgCgPSCgCgCgCgWZ[fWgWgCgCgCgCgCg"1eck22 ),u*<=CCEE {##c))"-dee"4":":"<"r staticmethodrn classmethodr{rrrrr1r-rr/r/`sp.X'''X' % % % % {?{?{?{?{?~   \ (666[6p(((\(:000\0d)))\)Z       r-r/r)r!rrr")r __future__rr_loggingretypingrrrragent.web_search_providerrtools.xai_httpr r r getLoggerrrrkrmr)compile MULTILINErr r,r/r1r-rrsI@#"""""  ,,,,,,,,,,,,777777  8 $ $  NBL99        $M M M M M ,M M M M M r-