Ji/ UdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z mZmZddlmZddlmZddlmZdd lmZejeZd d d d d ddddd Ze eefed<ddddZddgiZda e!ed<dZ"dZ#dZ$dZ%edz Z&dZ'd Z(d!ed"ee!ee ffd#Z)d$e d"efd%Z*dd$e d'ed"efd(Z+d)e d"e fd*Z,Gd+d,Z-Gd-d.Z.Gd/d0Z/Gd1d2Z0Gd3d4Z1Gd5d6Z2Gd7d8Z3Gd9d:Z4Gd;d<Z5Gd=d>Z6Gd?d@Z7GdAdBZ8d"ee9fdCZ:d!e9d"efdDZ;d"efdEZddHed"efdIZ?dHedJed"eefdKZ@d"eeeeeffdLZAd"eeeeeffdMZBd"efdNZCd"eeeeeffdOZDd"efdPZEd"eeeeeffdQZFd"eee eeffdRZGd"eee eeffdSZHdTed"eeeeeffdUZIdVdWdXdYdZd[ZJd"eeeeeffd\ZKd]efd^ZL dd!ed]ed_e!d`e!daedbed"eee eeffdcZMddHed"eeeeeffddZNddHefdeZOdfZPd!eed"efdgZQd!ed"eee eeffdhZRd!ed"e!fdiZSd"eefdjZTd"e efdkZU dddddld!eed]eedmeedneed_e!d"eeeee eeff doZVd"eeeeeffdpZWdqZXd"e9fdrZYdseZd"e9fdtZ[iZ\e e]e]fedu<ej^Z_ddvZ`dwe d"dfdxZaddyZbddzZc dd!ed]ed_e!dmedned"eee eeff d{Zd ddHed!ed]edmedned"eeeeeeeeff d|Zed}ZfeffdHed~egd"egfdZh dd!ed]edeideegdeeZdeeidegdee9dmeed"e9fdZj ddddddddddd dHed!ed]edmednedeidegdeZdeidegde9d"e fdZkd"efdZl ddddddddddd dHed!ed]edmednedeidegdeZdeidegde9d"e fdZmdS)a=Shared auxiliary client router for side tasks. Provides a single resolution chain so every consumer (context compression, session search, web extraction, vision analysis, browser vision) picks up the best available backend without duplicating fallback logic. Resolution order for text tasks (auto mode): 1. OpenRouter (OPENROUTER_API_KEY) 2. Nous Portal (~/.hermes/auth.json active provider) 3. Custom endpoint (config.yaml model.base_url + OPENAI_API_KEY) 4. Codex OAuth (Responses API via chatgpt.com with gpt-5.3-codex, wrapped to look like a chat.completions client) 5. Native Anthropic 6. Direct API-key providers (z.ai/GLM, Kimi/Moonshot, MiniMax, MiniMax-CN) 7. None Resolution order for vision/multimodal tasks (auto mode): 1. Selected main provider, if it is one of the supported vision backends below 2. OpenRouter 3. Nous Portal 4. Codex OAuth (gpt-5.3-codex supports vision via Responses API) 5. Native Anthropic 6. Custom endpoint (for local vision models: Qwen-VL, LLaVA, Pixtral, etc.) 7. None Per-task provider overrides (e.g. AUXILIARY_VISION_PROVIDER, CONTEXT_COMPRESSION_PROVIDER) can force a specific provider for each task. Default "auto" follows the chains above. Per-task model overrides (e.g. AUXILIARY_VISION_MODEL, AUXILIARY_WEB_EXTRACT_MODEL) let callers use a different model slug than the provider's default. Per-task direct endpoint overrides (e.g. AUXILIARY_VISION_BASE_URL, AUXILIARY_VISION_API_KEY) let callers route a specific auxiliary task to a custom OpenAI-compatible endpoint without touching the main model settings. N)Path)SimpleNamespace)AnyDictListOptionalTuple)OpenAI) load_pool)get_hermes_home)OPENROUTER_BASE_URLz glm-4.5-flashzkimi-k2-turbo-previewzMiniMax-M2.7-highspeedclaude-haiku-4-5-20251001zgoogle/gemini-3-flashgemini-3-flashzglm-5zgoogle/gemini-3-flash-preview) zaiz kimi-codingminimaxz minimax-cn anthropicz ai-gatewayz opencode-zenz opencode-gokilocode_API_KEY_PROVIDER_AUX_MODELSz%https://hermes-agent.nousresearch.comz Hermes Agentzproductivity,cli-agent)z HTTP-RefererzX-OpenRouter-TitlezX-OpenRouter-Categoriestagsproduct=hermes-agentFauxiliary_is_nousz)https://inference-api.nousresearch.com/v1zhttps://api.anthropic.comz auth.jsonz gpt-5.2-codexz%https://chatgpt.com/backend-api/codexproviderreturncR t|}n4#t$r'}td||Yd}~dSd}~wwxYw|r|sdS d|fS#t$r'}td||Yd}~dSd}~wwxYw)z2Return (pool_exists_for_provider, selected_entry).z0Auxiliary client: could not load pool for %s: %sN)FNTz8Auxiliary client: could not select pool entry for %s: %s)TN)r Exceptionloggerdebughas_credentialsselect)rpoolexcs 3/home/ubuntu/hermes-agent/agent/auxiliary_client.py_select_pool_entryr#ds""  GSVWWW{{{{{ t++--{T[[]]""  OQY[^___zzzzzs* A>AA55 B&?B!!B&entryc|dSt|ddpt|dd}t|pdS)Nruntime_api_key access_token)getattrstrstrip)r$keys r"_pool_runtime_api_keyr-tsN }r %*D 1 1 WWUNTV5W5WC syb>>   ! !!r&fallbackcH|6t|pddSt|ddp#t|ddpt|ddp|}t|pddS)Nr&/runtime_base_urlinference_base_urlbase_url)r*r+rstripr))r$r/urls r"_pool_runtime_base_urlr7}s }8>r""((**11#666 )400  5. 5 5  5*d + +    syb>>   ! ! ( ( - --r.contentc8t|tr|St|ts|rt|ndSg}|D]R}t|ts|dd}|dkr-|d|dddb|dkr|di}t|tr|ddnt|}d|d }t|tr|d nd }|r||d <|||d vr||"|dd}|r|d|dT|pdS) aConvert chat.completions content to Responses API format. chat.completions uses: {"type": "text", "text": "..."} {"type": "image_url", "image_url": {"url": "data:image/png;base64,..."}} Responses API uses: {"type": "input_text", "text": "..."} {"type": "input_image", "image_url": "data:image/png;base64,..."} If content is a plain string, it's returned as-is (the Responses API accepts strings directly for text-only messages). r&typetext input_text)r:r; image_urlr6 input_image)r:r=detailN)r<r>) isinstancer*listdictgetappend) r8 convertedpartptype image_datar6r$r?r;s r"_convert_content_for_responsesrIs'3 gt $ $/&.s7|||B.&(IGG$%%  $$ F??   lDHHVR>F3j #j j j j j j r.rKceZdZdZdefdZdS)_CodexChatShimz>Wraps the adapter to provide client.chat.completions.create().adapterc||_dSrO completionsrRrs r"rSz_CodexChatShim.__init__9"r.N)rrrrrKrSrxr.r"rr6s6HH# 8######r.rc(eZdZdZdedefdZdZdS)CodexAuxiliaryClientzOpenAI-client-compatible wrapper that routes through Codex Responses API. Consumers can call client.chat.completions.create(**kwargs) as normal. Also exposes .api_key and .base_url for introspection by async wrappers. rLrMc||_t||}t||_|j|_|j|_dSrO) _real_clientrKrchatapi_keyr4)rRrLrMrs r"rSzCodexAuxiliaryClient.__init__Ds@'*;>>"7++ "* #, r.c8|jdSrO)rcloserRs r"rzCodexAuxiliaryClient.closeKs !!!!!r.N)rrrrr r*rSrrxr.r"rr=sO -F-3----"""""r.rc*eZdZdZdefdZdefdZdS)_AsyncCodexCompletionsAdapterzAsync version of the Codex Responses adapter. Wraps the sync adapter via asyncio.to_thread() so async consumers (web_tools, session_search) can await it as normal. sync_adapterc||_dSrO_syncrRrs r"rSz&_AsyncCodexCompletionsAdapter.__init__V ! r.rcJKddl}|j|jjfi|d{VSNrasyncio to_threadrrrRr}rs r"rz$_AsyncCodexCompletionsAdapter.createYA&W&tz'8CCFCCCCCCCCCr.N)rrrrrKrSrrrxr.r"rrOs\ "%=""""DDDDDDDr.rceZdZdefdZdS)_AsyncCodexChatShimrc||_dSrOrrs r"rSz_AsyncCodexChatShim.__init___rr.N)rrrrrSrxr.r"rr^s0# =######r.rceZdZdZddZdS)AsyncCodexAuxiliaryClientzHAsync-compatible wrapper matching AsyncOpenAI.chat.completions.create(). sync_wrapperrc|jj}t|}t||_|j|_|j|_dSrO)rrrrrr4rRrr async_adapters r"rSz"AsyncCodexAuxiliaryClient.__init__fsA#(4 5lCC ' 66 #+ $- r.N)rr)rrrrrSrxr.r"rrcs.RR......r.rc4eZdZdZd dededefdZdefdZd S) _AnthropicCompletionsAdapterzautononerequired)rMrUr]rreasoning_configrrrirjrkrlrmrsrvrx)agent.anthropic_adapterrrrCrQr@r*rBlowerrrPrUrhasattrrir)r)rRr}rrrUrMr]rrrVnormalized_tool_choice choice_typeanthropic_kwargsresponseassistant_messagerurirnrorlrs r"rz#_AnthropicCompletionsAdapter.createvs````````::j"-- 7DK00 7##jj// ZZ --\>1EEl-ZkJkL#+"3)E !%'    H    r.NF) rrrrrr*boolrSrrxr.r"rrnscFF""C""t"""" 7 #7 7 7 7 7 7 r.rceZdZdefdZdS)_AnthropicChatShimrc||_dSrOrrs r"rSz_AnthropicChatShim.__init__rr.N)rrrrrSrxr.r"rrs0# <######r.rc 6eZdZdZd dededededef dZd Zd S) AnthropicAuxiliaryClientz@OpenAI-client-compatible wrapper over a native Anthropic client.FrLrMrr4rc|||_t|||}t||_||_||_dS)Nr)rrrrrr4)rRrLrMrr4rrs r"rSz!AnthropicAuxiliaryClient.__init__s?'.{EHUUU&w//    r.cht|jdd}t|r |dSdS)Nr)r)rcallable)rRclose_fns r"rzAnthropicAuxiliaryClient.closes?4,gt<< H    HJJJJJ  r.Nr) rrrrrr*rrSrrxr.r"rrsfJJ!!C!!c!S!\`!!!!r.rc&eZdZdefdZdefdZdS)!_AsyncAnthropicCompletionsAdapterrc||_dSrOrrs r"rSz*_AsyncAnthropicCompletionsAdapter.__init__rr.rcJKddl}|j|jjfi|d{VSrrrs r"rz(_AsyncAnthropicCompletionsAdapter.createrr.N)rrrrrSrrrxr.r"rrsR"%A""""DDDDDDDr.rceZdZdefdZdS)_AsyncAnthropicChatShimrc||_dSrOrrs r"rSz _AsyncAnthropicChatShim.__init__rr.N)rrrrrSrxr.r"rrs0# A######r.rceZdZddZdS)AsyncAnthropicAuxiliaryClientrrc|jj}t|}t||_|j|_|j|_dSrO)rrrrrr4rs r"rSz&AsyncAnthropicAuxiliaryClient.__init__sA#(4 9,GG +M:: #+ $- r.N)rr)rrrrSrxr.r"rrs(......r.rc td\}}|r|dSt|ddt|ddt|ddt|tt|ddt|ddt|d dt|d d d d S tsdSt jt}| ddkrdS| di di}| ds| dsdS|S#t$r&}t d|Yd}~dSd}~wwxYw)zRead and validate ~/.hermes/auth.json for an active Nous provider. Returns the provider state dict if Nous is active with tokens, otherwise None. nousNr(r& refresh_token agent_keyportal_base_url client_idscope token_typeBearerr ) r(rrr3rrrrsourceactive_provider providerszCould not read Nous auth: %s) r#r)r7_NOUS_DEFAULT_BASE_URL_AUTH_JSON_PATHis_filejsonloads read_textrCrrr) pool_presentr$datarr!s r"_read_nous_authrs -V44L%  =4#E>2>>$UOTBB  T::"8@V"W"W&u.?FF  T::UGT22!%x@@    &&(( 4z/335566 88% & && 0 0488K,,00<<||K(( n1M1M 4  3S999ttttts,"E=AEAEE F %FF cX|dp|ddS)z9Extract the best API key from a Nous provider state dict.rr(r&)rCrs r" _nous_api_keyrs' << $ $ H ^R(H(HHr.c6tjdtS)z8Resolve the Nous inference base URL from env or default.NOUS_INFERENCE_BASE_URL)osgetenvrrxr.r"_nous_base_urlrs 9.0F G GGr.c&td\}}|rt|}|pdS ddlm}|}|di}|d}t |t r|sdS ddl}| dd}|d t| d zzz }tj | |} | d d} | r4tj| krtd | dSn#t"$rYnwxYw|S#t"$r&} td | Yd} ~ dSd} ~ wwxYw)zJRead a valid, non-expired Codex OAuth access token from Hermes auth store. openai-codexNr)_read_codex_tokenstokensr(.=expz-Codex access token expired (exp=%s), skippingz2Could not read Codex auth for auxiliary client: %s)r#r-hermes_cli.authrrCr@r*r+base64splitlenrrurlsafe_b64decodetimerrr) rr$tokenrrrr(r payloadclaimsr r!s r"_read_codex_access_tokenr s,^<<L%%e,,}666666!!##(B''zz.11 ,,, L4F4F4H4H 4  MMM"((--a0G ss7||ma/0 0GZ 8 8 A ABBF**UA&&C ty{{S(( LcRRRt    D !!###  I3OOOttttts=A$E B)D<;E < E E E  E F*F  Fc ddlm}m}n+#t$rtdYdSwxYw|D]+\}}|jdkr|dkrtcSt|\}}|rt|}|sNt||j p|j }t|d}td|j|i} d |vrd d i| d <n)d |vrddlm} | | d <t'd||d| |fcS||} t)| dd}|sFt)| dddp|j }t|d}td|j|i} d |vrd d i| d <n)d |vrddlm} | | d <t'd||d| |fcSdS)zTry each API-key provider in PROVIDER_REGISTRY order. Returns (client, model) for the first provider with usable runtime credentials, or (None, None) if none are configured. rPROVIDER_REGISTRY$resolve_api_key_provider_credentialsz7Could not import PROVIDER_REGISTRY for API-key fallbackNNrrdefaultz'Auxiliary text client: %s (%s) via pool api.kimi.com User-Agent KimiCLI/1.0default_headersapi.githubcopilot.comcopilot_default_headersrr4r&r4r1zAuxiliary text client: %s (%s)rx)r rr ImportErrorrritems auth_type_try_anthropicr#r-r7r3rrCr_rhermes_cli.modelsr"r r*r+r5) rr provider_idpconfigrr$rr4rMextrar"credss r"_resolve_api_key_providerr-/s [[[[[[[[[  NOOOzz!2 7 7 9 9'J'J W   ) )  + % %!## # # #0== e  N+E22G -eW5OPPnT[TnH044[)LLE LLBGLRW X X XE!1!111,8-+H'(((HNN,<,<<<EEEEEE+B+B+D+D'(F'HFFFFM M M M44[AAeii 2..//5577  uyyR00117799@@EEcIc,00iHH 5w|UKKK X^^-- - -(4m'DE# $ $ $(8(8 8 8 A A A A A A'>'>'@'@E# $BgBBEBBEIIII :s  $33taskc|radD]^}tj||dd}|r |dkr|cS_dS)a5Read the provider override for a specific auxiliary task. Checks AUXILIARY_{TASK}_PROVIDER first (e.g. AUXILIARY_VISION_PROVIDER), then CONTEXT_{TASK}_PROVIDER (for the compression section's summary_provider), then falls back to "auto". Returns one of: "auto", "openrouter", "nous", "main".  AUXILIARY_CONTEXT_ _PROVIDERr&r)rrupperr+r)r.prefixvals r"_get_auxiliary_providerr7isy 0  F)v>tzz||>>>CCIIKKQQSSC sf}} 6r.suffixc|sdSdD]H}tj||d|d}|r|cSIdS)zFRead an auxiliary env override from AUXILIARY_* or CONTEXT_* prefixes.Nr0_r&)rrr4r+)r.r8r5r6s r"_get_auxiliary_env_overrider;xsq t,i6:4::<<::&::B??EEGG  JJJ  4r.ctd\}}|rgt|}|sdSt|tpt}tdt ||ttfStj d}|sdStdt |tttfS)N openrouterrz%Auxiliary client: OpenRouter via pool)rr4rOPENROUTER_API_KEYzAuxiliary client: OpenRouter) r#r-r7r rrr _OR_HEADERS_OPENROUTER_MODELrr)rr$or_keyr4s r"_try_openrouterrBs,\::L%G&u-- :)%1DEE\I\ <===fx'24445FG GY+ , ,F z LL/000 &+>#. 0 0 01B CCr.cdt}|sdSdatd|ddkrdnt }t t|t|dp t d |fS) NrTzAuxiliary client: Nous Portalrr rr3r1r#) rrrrrC _NOUS_MODELr rr*rr5)rrMs r" _try_nousrEs   D z LL0111 $ 2 2f < <  +E!$''"677K>;K;KLLSSTWXX      r.c ddlm}|}|di}t|tr(|r|St|t rS|dd}t|tr(|r|Sn#t$rYnwxYwdS)zRead the user's configured main model from config.yaml. config.yaml model.default is the single source of truth for the active model. Environment variables are no longer consulted. r load_configrMrr&)hermes_cli.configrHrCr@r*r+rBr)rHcfg model_cfgrs r"_read_main_modelrLs  111111kmmGGGR(( i % % %)//*;*; %??$$ $ i & & 'mmIr22G'3'' 'GMMOO '}}&      2sA"C%A'C CCc: ddlm}|d}n3#t$r&}td|Yd}~dSd}~wwxYw|d}|d }t |tr|sdS| d }d | vrdSt |tr|sd }||fS) zResolve the active custom/main endpoint the same way the main CLI does. This covers both env-driven OPENAI_BASE_URL setups and config-saved custom endpoints where the base URL lives in config.yaml instead of the live environment. r)resolve_runtime_providercustom) requestedz6Auxiliary client: custom runtime resolution failed: %sNrr4rr1z openrouter.aino-key-required) hermes_cli.runtime_providerrNrrrrCr@r*r+r5r)rNruntimer! custom_base custom_keys r"_resolve_custom_runtimerVs=HHHHHH**X>>>  MsSSSzzzzz++j))KY''J k3 ' '{/@/@/B/Bz##%%,,S11K+++----z j# & &'j.>.>.@.@'&  ((** **s AAAc,t\}}|pdS)Nr&)rV)rTr:s r"_current_custom_base_urlrXs,..NK  "r.ct\}}|r|sdStpd}td|t |||fS)Nr gpt-4o-miniz&Auxiliary client: custom endpoint (%s)r#)rVrLrrr )rTrUrMs r"_try_custom_endpointr[sc577K jz    /-E LL95AAA *{ ; ; ;U BBr.cVtd\}}|r0t|}|sdSt|tpt}nt }|sdSt}t dtt||}t|ttfS)Nrrz4Auxiliary client: Codex OAuth (%s via Responses API)r#) r#r-r7_CODEX_AUX_BASE_URLrrr_CODEX_AUX_MODELr r)rr$ codex_tokenr4rLs r" _try_codexr`s,^<<L% '+E22  :)%1DEE\I\.00  :& LLGIYZZZx@@@K  -= > >@P PPr.c ddlm}m}n#t$rYdSwxYwt d\}}|r|dSt |}n d}|}|sdS|rt |tnt} ddlm }|}| d}t|trt| dpd} | dkr@| d pdd } | r| }n#t"$rYnwxYwdd lm} | |} t& dd } t(d | ||  |||}n#t$rYdSwxYwt-|| ||| | fS)Nr)build_anthropic_clientresolve_anthropic_tokenrrrGrMrr&r4r1)_is_oauth_tokenrz8Auxiliary client: Anthropic native (%s) at %s (oauth=%s)r)rrbrcr$r#r-r7_ANTHROPIC_DEFAULT_BASE_URLrIrHrCr@rBr*r+rr5rrdrrrr)rbrcrr$rr4rHrJrK cfg_provider cfg_base_urlrdrrMrLs r"r'r'sQ[[[[[[[[[ zz-[99L%* =:%e,,'')) z NZz%e-HIII_zH  111111kmmGGG$$ i & & ,y}}Z88>B??EEGGMMOOL{** ) j 9 9 ?RFFHHOOPSTT ,+H      877777u%%H ( , ,[:U V VE LLKUT\^fggg,,UH== zz  $KxRZ [ [ []b bbs1 3CD<< E E  F## F10F1forcedc"|dkr1t\}}|td||fS|dkr1t\}}|td||fS|dkr1t \}}|td||fS|dkrHt tt fD]}|\}}|||fcStd d Std |d S) zKResolve a specific forced provider. Returns (None, None) if creds missing.r=Nzauxiliary.provider=main but no main endpoint credentials foundrz3Unknown auxiliary.provider=%r, falling back to auto)rBrwarningrEr`r[r-)rhclientrMtry_fns r"_resolve_forced_providerro/s2 '))  > NNY Z Z Zu} !  > NNg h h hu} "  > NNh i i iu} +Z9RS % %F"FHHMFE!u}$$$"WXXXz NNH&QQQ :r.r=rz local/customrzapi-key)rBrEr[r`r-c dag}ttttt fD]}t |dd}t||}|\}}|Y|r3t d||pdd |nt d||pd||fcS| |t d d |d S) uYFull auto-detection chain: OpenRouter → Nous → custom → Codex → API-key → None.FrunknownNu4Auxiliary auto-detect: using %s (%s) — skipped: %sr, z$Auxiliary auto-detect: using %s (%s)zAuxiliary auto-detect: no provider available (tried: %s). Compression, summarization, and memory flush will not work. Set OPENROUTER_API_KEY or configure a local model in config.yaml.r)rrBrEr[r`r-r)_AUTO_PROVIDER_LABELSrCrinfor|rDrl)triedrnfn_namelabelrmrMs r" _resolve_autorxZs$ E"I/C8:  &*i88%))'7;;    _ R!5#5Ityy7G7GIIII BE5K]T]^^^5=  U NNW99U##%%% :r.rMcddlm}t|trt ||fSt|t rt ||fS|jt|j d}t|j  }d|vrtt|d<n#d|vrddl m}||d<n d|vrd d i|d<|d i||fS) zIConvert a sync client to its async counterpart, preserving Codex routing.r) AsyncOpenAIr#r=rr r!rrrrx)openairzr@rrrrrr*r4rrBr?r(r") sync_clientrMrz async_kwargs base_lowerr"s r"_to_async_clientr~s,""""""+344=(55u<<+788A,[995@@& ,--L[)**0022Jz!!*.{*;*; &'' J . .======*A*A*C*C &'' : % %+7*G &' ; & & & & --r. async_mode raw_codexexplicit_base_urlexplicit_api_keyc |pd}|dkrd}|dkrd}|dkrYt\}}|dS|r(d|vr$|r"d|vrtd ||d}|p|}|rt ||n||fS|d krIt \}} |td dS|p| }|rt ||n||fS|d krIt\}} |td dS|p| }|rt ||n||fS|dkr|rOt} | stddS|pt}t| t} | |fSt\}} |tddS|p| }|rt ||n||fS|dkr |r|} |pdp(tjddpd} | stddS|pt!pd}t| | }|rt ||n||fSt"tt$fD]-}|\}} ||p| }|rt ||n||fcS.tddS ddlm}m}n,#t,$rtd|YdSwxYw||}|td|dS|jdkr|dkrIt3\}}|tddS|p|}|rt ||n||fS||}t5|dd}|s`t7|j}|dkr|dtd|d |dSt5|d!ddp|j }tB|d}|p|}i}d"|vrd#|d$<n9d%|vr#dd&l"m#}|$|td,||d|rd'|ini}td(|||rt ||n||fS|jd)vrK|d krtKd ||S|dkrtKd||Std*|dStd+|j|dS)-uCentral router: given a provider name and optional model, return a configured client with the correct auth, base URL, and API format. The returned client always exposes ``.chat.completions.create()`` — for Codex/Responses API providers, an adapter handles the translation transparently. Args: provider: Provider identifier. One of: "openrouter", "nous", "openai-codex" (or "codex"), "zai", "kimi-coding", "minimax", "minimax-cn", "custom" (OPENAI_BASE_URL + OPENAI_API_KEY), "auto" (full auto-detection chain). model: Model slug override. If None, uses the provider's default auxiliary model. async_mode: If True, return an async-compatible client. raw_codex: If True, return a raw OpenAI client for Codex providers instead of wrapping in CodexAuxiliaryClient. Use this when the caller needs direct access to responses.stream() (e.g., the main agent loop). explicit_base_url: Optional direct OpenAI-compatible endpoint. explicit_api_key: Optional API key paired with explicit_base_url. Returns: (client, resolved_model) or (None, None) if auth is unavailable. rrjrrkrONrr1z\Dropping OpenRouter-format model %r for non-OpenRouter auxiliary provider (using %r instead)r=zLresolve_provider_client: openrouter requested but OPENROUTER_API_KEY not setrzZresolve_provider_client: nous requested but Nous Portal not configured (run: hermes login)zbresolve_provider_client: openai-codex requested but no Codex OAuth token found (run: hermes model)r#r&OPENAI_API_KEYrQzQresolve_provider_client: explicit custom endpoint requested but base_url is emptyrZzPresolve_provider_client: custom/main requested but no endpoint credentials foundrrz-hermes_cli.auth not available for provider %sz,resolve_provider_client: unknown provider %rrrzOresolve_provider_client: anthropic requested but no Anthropic credentials foundcopilotz gh auth tokenzJresolve_provider_client: provider %s has no API key configured (tried: %s)rrr4rrrr r!rz resolve_provider_client: %s (%s))oauth_device_codeoauth_externalzMresolve_provider_client: OAuth provider %s not directly supported, try 'auto'z6resolve_provider_client: unhandled auth_type %s for %srx)&r+rrxrrrrBrlrErr^r r]r`rrrLr[r-r rrr$rCr&r'r*rAapi_key_env_varsrDr|r5r3rr(r"updateresolve_provider_client)rrMrrrrrmresolved final_modelrr_ raw_clientrTrUrnrrr* default_modelr,r tried_sourcesr4headersr"s r"rrsF"F))++1133H7!66(?? >:  SE\\h\3h3F3F LL89> J J JE'x 9C+ 555k* ,<)++ > NN< = = =:&w 9C+ 555k* ,6#++ > NNP Q Q Q:&w 9C+ 555k* ,>!!  -344K " TUUU!z3#3K >QRRRJ , ,$,, > NNP Q Q Q:&w 9C+ 555k* ,8  0+1133K!'R..00%9-r2288::%$   ","zF#3#5#5FKJEEEF=G/$V[999 +. 0,Z02 4 4F$fhhOFG!#.w AK3(===$k2444" ; < < <z[[[[[[[[[  DhOOOzz ##H--GExPPPzI%% { " "$2$4$4 !FM~pqqq!z0=K=Gb$V[999fVaMb c44X>>eii 2..//5577  !9::M9$$$$_555 LL6!499]#;#; = = =:uyyR00117799@@EEcIc4882FF ,}  X^^-- - -$1GL ! ! $(8(8 8 8 A A A A A A NN2244 5 5 5M(MM;BJ-w77MM 7;OOO9C+ 555k* ,  E E E v  *65*EE E ~ % %*>5*MM M89A C C Cz NNK$h000 :s(K11%LLcTt|pd\}}}}t||||S)aXReturn (client, default_model_slug) for text-only auxiliary tasks. Args: task: Optional task name ("compression", "web_extract") to check for a task-specific provider override. Callers may override the returned model with a per-task env var (e.g. CONTEXT_COMPRESSION_MODEL, AUXILIARY_WEB_EXTRACT_MODEL). N)rMrr_resolve_task_provider_modelrr.rrMr4rs r"get_text_auxiliary_clientrdsB*Fdld)S)S&HeXw ""    r.cVt|pd\}}}}t||d||S)aReturn (async_client, model_slug) for async consumers. For standard providers returns (AsyncOpenAI, model). For Codex returns (AsyncCodexAuxiliaryClient, model) which wraps the Responses API. Returns (None, None) when no provider is available. NTrMrrrrrs r"get_async_text_auxiliary_clientrwsE*Fdld)S)S&HeXw ""    r.)r=rrrrOcv|pd}|dkrdS|dkrdS|S)NrrjrrkrO)r+rrs r"_normalize_vision_providerrsI"F))++1133H7~6x Or.ct|}|dkrtS|dkrtS|dkrtS|dkrt S|dkrt SdS)Nr=rrrrOr)rrBrEr`r'r[rs r"_resolve_strict_vision_backendrs)(33H<   6{{>!!||;8#%%% :r.c0t|dduSr)rrs r" _strict_vision_backend_availablers )( 3 3A 6d BBr.c ddlm}|}|di}t|tr.t |dd}|t vr|Sn#t$rYnwxYwdS)zMReturn the selected main provider when it is also a supported vision backend.rrGrMrr&N)rIrHrCr@rBr_VISION_AUTO_PROVIDER_ORDERr)rHconfigrKrs r"_preferred_main_vision_providerrs  111111JJw++ i & & 1)-- B2O2OPPH666      4sA(A,, A98A9ctt}t}||vr+|||d|d|DS)a\Return the currently available vision backends in auto-selection order. This is the single source of truth for setup, tool gating, and runtime auto-routing of vision tasks. The selected main provider is preferred when it is also a known-good vision backend; otherwise Hermes falls back through the standard conservative order. rc0g|]}t||Srx)r).0rs r" z1get_available_vision_backends..s' [ [ [0PQY0Z0Z [H [ [ [r.)rArrremoveinsert)ordered preferreds r"get_available_vision_backendsrsb.//G/11IGy!!!q)$$$ [ [W [ [ [[r.)r4rrr4rctd||||\}}}t|}dtdtdttffd }|r t d||\} } | d Sd| | fS|d krt t} t} | | vr+| | | d | | D]%} t| \}}||| ||cS&t d d S|tvrt|\}}||||St|\} } | |ddfS|| | fS)arResolve the client actually used for vision tasks. Direct endpoint overrides take precedence over provider selection. Explicit provider overrides still use the generic provider router for non-standard backends, so users can intentionally force experimental providers. Auto mode stays conservative and only tries vision backends known to work today. visionresolved_providerr|rcX||ddfSp|}rt||\}}|||fS|||fSrO)r)rr|rr async_client async_modelrresolved_models r" _finalizez1resolve_vision_provider_client.._finalizesW  $dD0 0$5  @(8k(R(R %L+$lK? ? +{::r.rOrN)rONNrrz'Auxiliary vision client: none available)NNN)rrr*rrrrArrrrrrr_get_cached_client)rrMr4rrrPresolved_base_urlresolved_api_keyrrmrrr candidater|rrs ` @r"resolve_vision_provider_clientrsFb(E8WFFBI~02B+955I;S;s;8TW=;;;;;;; -5  !/-      >'',,F233355    NN9 % % % NN1i ( ( (  H HI)G )R)R &K& yKGGGGG' >???///%CI%N%N" ]yK???,Y SSFK ~$$$ fk ))r.c2td\}}}||fS)zJReturn (client, default_model_slug) for vision/multimodal auxiliary tasks.Frrr:rmrs r"get_vision_auxiliary_clientrs$;uMMMAv{ ; r.c2td\}}}||fS)z=Return (async_client, model_slug) for async vision consumers.Trrrs r"!get_async_vision_auxiliary_clientrs$;tLLLAv{ ; r.c<trttniS)zReturn extra_body kwargs for auxiliary API calls. Includes Nous Portal product tags when the auxiliary client is backed by Nous Portal. Returns empty dict otherwise. )rrBNOUS_EXTRA_BODYrxr.r"get_auxiliary_extra_bodyrs %6 =4 2=r.valuect}tjd}|s(td|vrd|iSd|iS)aFReturn the correct max tokens kwarg for the auxiliary client's provider. OpenRouter and local models use 'max_tokens'. Direct OpenAI with newer models (gpt-4o, o-series, gpt-5+) requires 'max_completion_tokens'. The Codex adapter translates max_tokens internally, so we use max_tokens for it as well. r>Napi.openai.comrr)rXrrrr)rrTrAs r"auxiliary_max_tokens_paramr#s`+,,K Y+ , ,F 0!!) K$5$5$7$777'// %  r. _client_cachecT ddlm}d|_dS#ttf$rYdSwxYw)aMonkey-patch ``AsyncHttpxClientWrapper.__del__`` to be a no-op. The OpenAI SDK's ``AsyncHttpxClientWrapper.__del__`` schedules ``self.aclose()`` via ``asyncio.get_running_loop().create_task()``. When an ``AsyncOpenAI`` client is garbage-collected while prompt_toolkit's event loop is running (the common CLI idle state), the ``aclose()`` task runs on prompt_toolkit's loop but the underlying TCP transport is bound to a *different* loop (the worker thread's loop that the client was originally created on). If that loop is closed or its thread is dead, the transport's ``self._loop.call_soon()`` raises ``RuntimeError("Event loop is closed")``, which prompt_toolkit surfaces as "Unhandled exception in event loop ... Press ENTER to continue...". Neutering ``__del__`` is safe because: - Cached clients are explicitly cleaned via ``_force_close_async_httpx`` on stale-loop detection and ``shutdown_cached_clients`` on exit. - Uncached clients' TCP connections are cleaned up by the OS when the process exits. - The OpenAI SDK itself marks this as a TODO (``# TODO(someday): support non asyncio runtimes here``). Call this once at CLI startup, before any ``AsyncOpenAI`` clients are created. rAsyncHttpxClientWrappercdSrOrxrs r"z(neuter_async_httpx_del..bstr.N)openai._base_clientr__del__r$AttributeErrorrs r"neuter_async_httpx_delrFsR4 ??????*;*;'''  (     s ''rmc ddlm}t|dd}|t|dds|j|_dSdSdS#t $rYdSwxYw)uMark the httpx AsyncClient inside an AsyncOpenAI client as closed. This prevents ``AsyncHttpxClientWrapper.__del__`` from scheduling ``aclose()`` on a (potentially closed) event loop, which causes ``RuntimeError: Event loop is closed`` → prompt_toolkit's "Press ENTER to continue..." handler. We intentionally do NOT run the full async close path — the connections will be dropped by the OS when the process exits. r) ClientStaterPN is_closedT) httpx._clientrr)CLOSED_stater)rmrinners r"_force_close_async_httpxrgs ------ 400  WUK%F%F &-ELLL          s6> A  A cddl}t5ttD]b\}}|d}|t | t |dd}|r||s |S#t$rY_wxYwt ddddS#1swxYwYdS)zClose all cached clients (sync and async) to prevent event-loop errors. Call this during CLI shutdown, *before* the event loop is closed, to avoid ``AsyncHttpxClientWrapper.__del__`` raising on a dead loop. rNr) inspect_client_cache_lockrArr%rr)iscoroutinefunctionrclear)rr,r$rmrs r"shutdown_cached_clientsr{s0 NNN }224455  JC1XF~ %V , , , "67D99G$?$?$I$IHJJJ    !s6AB<2BB< BB<BB<<CCc$t5g}tD]E\}}|\}}}|8|r$t |||F|D] }t|= ddddS#1swxYwYdS)uKForce-close cached async clients whose event loop is closed. Call this after each agent turn to proactively clean up stale clients before GC can trigger ``AsyncHttpxClientWrapper.__del__`` on them. This is defense-in-depth — the primary fix is ``neuter_async_httpx_del`` which disables ``__del__`` entirely. N)rrr%rrrD) stale_keysr,r$rm_default cached_loops r"cleanup_stale_async_clientsrs ## '--// ' 'JC,1 )FHk&;+@+@+B+B&(000!!#&&& # #Cc"" ###################sA/BB  B cd}d}|r9 ddl}|}t|}n#t$rYnwxYw|||pd|pd|f}t5|t vret |\} } } |r@| ,| rt| t |=n$| |p| fcdddS| |p| fcdddSdddn #1swxYwYt|||||\} } | I|}t5|t vr| | |ft |<nt |\} } }dddn #1swxYwY| |p| fS)aGet or create a cached client for the given provider. Async clients (AsyncOpenAI) use httpx.AsyncClient internally, which binds to the event loop that was current when the client was created. Using such a client on a *different* loop causes deadlocks or RuntimeError. To prevent cross-loop issues (especially in gateway mode where _run_async() may spawn fresh loops in worker threads), the cache key for async clients includes the current event loop's identity so each loop gets its own client instance. rNr&)rr) rget_event_looprh RuntimeErrorrrrrr)rrMrr4rloop_id current_loop_aio cache_key cached_clientcached_defaultrrmr bound_loopr:s r"rrs(GL  " " " "..00L&&GG    D :x~2w}"gNI  > >  % %9Fy9Q 6M>; >*{/D/D/F/F*,];;;%i00(%*A>A > > > > > > > >%e&=~= > > > > > > > > > > > > > > > > > > > > > > >4 " FM"  D D --,2M:+N i((+8+C( q  D D D D D D D D D D D D D D D 5)M ))s7'0 ==AC /C  CC:)D//D36D3ci}d}d}d}d} |rF ddlm} | }n#t$ri}YnwxYwt|tr|dini} t| tr| |ini} t| tsi} t | ddpd}t | ddpd}t | ddpd}t | d dpd} |d kr|r|d krt|tr|d ini} t| tr| d dpd}|p)| d dpd}| dpd}|p|pd}|rt|dnd}|p|p|}|rd|||fS|r||||fS|rat|d}t|d}|rd|||p| fSt|}|d kr||ddfS|rd||| fS|r |d kr||ddfSd |ddfSd |ddfS)aDetermine provider + model for a call. Priority: 1. Explicit provider/model/base_url/api_key args (always win) 2. Env var overrides (AUXILIARY_{TASK}_*, CONTEXT_{TASK}_*) 3. Config file (auxiliary.{task}.* or compression.*) 4. "auto" (full auto-detection chain) Returns (provider, model, base_url, api_key) where model may be None (use provider default). When base_url is set, provider is forced to "custom" and the task uses that direct endpoint. NrrG auxiliaryrr&rMr4r compressionrsummary_provider summary_modelsummary_base_urlMODELrOBASE_URLAPI_KEY) rIrHr$r@rBrCr*r+r;r7)r.rrMr4rrrf cfg_modelrg cfg_api_keyrHaux task_configcomp_sbu env_modelr env_base_url env_api_key env_providers r"rrsq&FLILK D  5 5 5 5 5 5 []]FF   FFF .8-E-EMfjjb)))2+5c4+@+@HcggdB'''b +t,, K;??:r::;;AACCKt  4455;;==E ;??:r::;;AACCKt +//)R8899??AAIT = , ,&:P:P4>vt4L4LT6::mR000RTD$%% D#xx(:B??EEGGO4 %V/2)F)F)L)L)N)NVRV xx 2339r+Ctzz||Ct >BL+D':::I4i49N;7::;7:: 224DD 1$ BB  V^\;;U+U U.t44 6 ! !t; ;  G^\;F F  4 --s  //>@rc|s|S ddlm}|}n#t$r|cYSwxYwt|tr|dini}t|tr||ini}|d}|' t |S#ttf$rYnwxYw|S)zPRead timeout from auxiliary.{task}.timeout in config, falling back to *default*.rrGrtimeout) rIrHr$r@rBrCfloat ValueError TypeError)r.rrHrrrraws r"_get_task_timeoutr ;s 111111 )3FD)A)A I&**[" % % %rC'1#t'<'<D#''$###"K //) $ $C  :: I&    D  Ns &&B**B>=B>rUrVrr]r extra_bodyc J|||d} ||| d<|=|dkr2|p t} d| vr|| d<n || d<n|| d<|r|| d<t|pi} |d kstr*| d gd g| r| | d <| S) zLBuild kwargs for .chat.completions.create() with model/provider adjustments.)rMrUrNrVrOrrrr]rrrr )rXrrBr setdefaultextend) rrMrUrVrr]rr r4r}rT merged_extras r"_build_call_kwargsrOsF  +} x  "@&>&@&@K;#4#4#6#6662<.//'1|$$#-F<   w (b))L6.++224J3KLLL,+| Mr.) rrMr4rrVrr]rr c t|||||\} } } }|dkrpt||||d\}}}|9| dkr3| s1td| td| d\}}}|t d|d | d |p| } nt | | | | \}}|| pd }|r,|d vr(t d|d|d| s8t d|pd| t d| pt\}}|t d|d | d | | nt|}tt|d| pd }|r-t d|| pd|pd|r d|vrd|nd t| ||||||| |  } |jjjdi|S#t$$rT}t|}d|vsd|vr7|dd||d<|jjjdi|cYd}~Sd}~wwxYw)aCentralized synchronous LLM call. Resolves provider + model (from task config, explicit args, or auto-detect), handles auth, request formatting, and model-specific arg adjustments. Args: task: Auxiliary task name ("compression", "vision", "web_extract", "session_search", "skills_hub", "mcp", "flush_memories"). Reads provider:model from config/env. Ignored if provider is set. provider: Explicit provider override. model: Explicit model override. messages: Chat messages list. temperature: Sampling temperature (None = provider default). max_tokens: Max output tokens (handles max_tokens vs max_completion_tokens). tools: Tool definitions (for function calling). timeout: Request timeout in seconds (None = read from auxiliary.{task}.timeout config). extra_body: Additional request body fields. Returns: Response object with .choices[0].message.content Raises: RuntimeError: If no provider is configured. rFrrMr4rrNrDVision provider %s unavailable, falling back to auto vision backendsrrMr$No LLM provider configured for task= provider=. Run: hermes setup)r4rr&rr=rO Provider ':' is set in config.yaml but no API key was found. Set the U_API_KEY environment variable, or switch to a different provider with `hermes model`.zAAuxiliary %s: provider %s unavailable, falling back to openroutercallr=r4zAuxiliary %s: using %s (%s)%srz at rVrr]rr r4runsupported_parameterrrx)rrrrlrrr+rr4rtr@r r*r)rrrrrpop)r.rrMr4rrUrVrr]rr rrrreffective_providerrmr _expliciteffective_timeout _base_infor} first_errerr_strs r"call_llmr%}sLNj hxN2N2J~'8:J x2P 3 3 3 /FK >/699BS9 NNV!   7U$ 777 3  >%t%%GX%%% /C2C0  &$     >+0b7799??AAI Y.NNN"XXX*3//*;*;XXX % G _ NF,=???&8 ."E4E'G'G# >%t%%GX%%%&& &$+#6.*?)flags) reasoningreasoning_contentreasoning_detailssummaryr8r;z )rerwrcr8r+subDOTALL IGNORECASEr)r@r*rDrArBrCr|) rr,rr8cleanedreasoning_partsfieldr6detailsr?r+s r"extract_content_or_reasoningr4sIII  1  %C{ b''))G && D ry2=8   %''   N"$O300c5$''  0:c3'' 0CIIKK 0CV>V+h7==???\_`g\h\hiii,{{?+++ 2r.c Kt|||||\} } } }|dkrpt||||d\}}}|9| dkr3| s1td| td| d\}}}|t d|d | d |p| } nt | | d| | \}}|| pd }|r,|d vr(t d|d|d| s7td| t d| ptd\}}|t d|d | d | | nt|}t| ||||||| |  } |j j jdi|d{VS#t$rZ}t!|}d|vsd|vr=|dd||d<|j j jdi|d{VcYd}~Sd}~wwxYw)zqCentralized asynchronous LLM call. Same as call_llm() but async. See call_llm() for full documentation. rTrNrrrrrr)rr4rr&rrrrz3Provider %s unavailable, falling back to openrouterr=rrrrrrx)rrrrlrrr+rr4r@r rrrrrr*r)r.rrMr4rrUrVrr]rr rrrrrrmrr r!r}r#r$s r"async_call_llmr6.s`$Nj hxN2N2J~'8:J x2P 3 3 3 /FK >/699BS9 NNV!   7U$777 3  >%t%%GX%%% /C2C0  &$      >*0b7799??AAI Y.NNN"XXX*3//*;*;XXX % %T0222&8 ."E4E#'%'%'%#  >%t%%GX%%%&& &$+#6$AG92G>8G99G>)r&)NFFNNr)rN)NFNN)NNNNN)NNNrNNrO)nrrloggingr threadingrpathlibrtypesrtypingrrrrr r{r agent.credential_poolr rIr hermes_constantsr getLoggerrrrr*__annotations__r?rrrr@rDrrerr^r]r#r-r7rIrKrrrrrrrrrrrrBrrrrr-r7r;rBrErLrVrXr[r`r'rorsrxrrrrrrrrrrrrrrintrrtupleLockrrrrrrr_DEFAULT_AUX_TIMEOUTrr rArr%r4r6rxr.r"rDs4$$$L   !!!!!!33333333333333++++++------000000  8 $ $ *'*,)$/ 0 0d38n   <(7 234 44- D9!/##k1#=  tXc]/B)C     """""" . .# . .c . . . .(-C-C----`r r r r r r r r j########""""""""$ D D D D D D D D######## ........? ? ? ? ? ? ? ? D########         DDDDDDDD######## ........#$####LIDISIIII HHHHH (3-    F55&)98C=)H#I5555t  # s    c38C=Cx/#>?CCCC&5&)8C=89"#*!+x}hsm'C!D!+!+!+!+H# CeHV$4hsm$CDCCCCQE(3-#67QQQQ"-chsmXc]:;-c-c-c-c`SU8F3CXc]3R-SF$* !* uXf-x}<=H.....6! HHH HH H  H  H 8C=(3- '(HHHHZCx7GRU7V1W&#"#3 S U8C=(SV-;W5X    CsCtCCCC #     \tCy \ \ \ \"#>*#! >*>*>*sm>* C=>*sm >* c] >*  >* 8C=(3-# 67>*>*>*>*BU8F+;Xc]+J%K  >$>>>>!c!d!!!!>%' tE5L!&&&#Y^%%    B S T    (6####* =*=*=* =*=* =*  =*  8C=(3- '( =*=*=*=*B L.L. L.L. L. L.  L.  3 x}hsm ;< L.L.L.L.^3GC%50$( $ !%"+++ ++% +  + D> +++sm+ ++++^vvvv vv  v  v  vvvv vvv vvvvr5c5555rXXXX XX  X  X  XXXX XXX XXXXXXr.