L0&jgMdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z ddl mZmZdaejZdZd Zd Zd Zd ed dfdZd.dZd.dZeGddejZdddddddZdddddddde e de ede ede ede ed ed e fd!Z d.d"Z!Gd#d$eZ"dd%d&ej#d'e d(ed)eded*ej$d+e ejd dfd,Z%d-Z&dS)/u Centralized logging setup for Hermes Agent. Provides a single ``setup_logging()`` entry point that both the CLI and gateway call early in their startup path. All log files live under ``~/.hermes/logs/`` (profile-aware via ``get_hermes_home()``). Log files produced: agent.log — INFO+, all agent/tool/session activity (the main log) errors.log — WARNING+, errors and warnings only (quick triage) gateway.log — INFO+, gateway-only events (created when mode="gateway") gui.log — INFO+, dashboard/websocket/TUI-gateway events (created when mode="gui") All files use ``RotatingFileHandler`` with ``RedactingFormatter`` so secrets are never written to disk. Component separation: gateway.log only receives records from ``gateway.*`` loggers — platform adapters, session management, slash commands, delivery. gui.log receives dashboard-side records from ``hermes_cli.web_server``, ``hermes_cli.pty_bridge``, ``tui_gateway.*``, and ``uvicorn.*``. agent.log remains the catch-all (everything goes there). Session context: Call ``set_session_context(session_id)`` at the start of a conversation and ``clear_session_context()`` when done. All log lines emitted on that thread will include ``[session_id]`` for filtering/correlation. N)RotatingFileHandler)Path)OptionalSequence)get_config_pathget_hermes_homeFz>%(asctime)s %(levelname)s%(session_tag)s %(name)s: %(message)szC%(asctime)s - %(name)s - %(levelname)s%(session_tag)s - %(message)sc*tj}t|ddpd}|dddvr|S t|dd}|"t j|ddd }d |_|Sn#t$rYnwxYw|S) uReturn a stderr stream that tolerates Unicode on all platforms. On Windows the console encoding is often a legacy MBCS codec (cp949, cp1252, …) that raises ``UnicodeEncodeError`` for characters like the em-dash (U+2014). We wrap ``sys.stderr`` in a ``TextIOWrapper`` with ``errors='replace'`` so log lines are never lost — un-encodable characters are replaced with ``?`` instead of crashing the process. encodingNutf-8-)utf8utf8surrogateescapebufferreplaceT)r errorsline_bufferingcdSNr3/home/ubuntu/.hermes/hermes-agent/hermes_logging.pyz_safe_stderr..RsDr) sysstderrgetattrlowerrio TextIOWrapperclose Exception)streamr bufwrappeds r _safe_stderrr%8sZFvz400;GH~~R((,KKK  fh-- ?&  # G)LGMN        Ms 4B BB)openaizopenai._base_clienthttpxhttpcoreasynciohpackz hpack.hpackgrpcmodalurllib3zurllib3.connectionpool websocketscharset_normalizer markdown_it session_idreturnc|t_dS)zSet the session ID for the current thread. All subsequent log records on this thread will include ``[session_id]`` in the formatted output. Call at the start of ``run_conversation()``. N_session_contextr1)r1s rset_session_contextr6ps #-rcdt_dS)z,Clear the session ID for the current thread.Nr4rrrclear_session_contextr8ys"&rctjtddrdSfd}d|_tj|dS)ubReplace the global LogRecord factory with one that adds ``session_tag``. Unlike a ``logging.Filter`` on a handler or logger, the record factory runs for EVERY record in the process — including records that propagate from child loggers and records handled by third-party handlers. This guarantees ``%(session_tag)s`` is always available in format strings, eliminating the KeyError that would occur if a handler used our format without having a ``_SessionFilter`` attached. Idempotent — checks for a marker attribute to avoid double-wrapping if the module is reloaded. _hermes_session_injectorFNcb|i|}ttdd}|rd|dnd|_|S)Nr1z []r )rr5 session_tag)argskwargsrecordsidcurrent_factorys r_session_record_factoryz@_install_session_record_factory.._session_record_factorysG $1&11& d;;,/7[#[[[[R rT)logginggetLogRecordFactoryrr:setLogRecordFactory)rCrBs @r_install_session_record_factoryrGsi133O :EBB 8<4  788888rcReZdZdZdeeddffd Zdejde fdZ xZ S)_ComponentFilterzOnly pass records whose logger name starts with one of *prefixes*. Used to route gateway-specific records to ``gateway.log`` while keeping ``agent.log`` as the catch-all. prefixesr2Ncptt||_dSr)super__init__tuple _prefixes)selfrJ __class__s rrMz_ComponentFilter.__init__s* xrr@c@|j|jSr)name startswithrO)rPr@s rfilterz_ComponentFilter.filters{%%dn555r) __name__ __module__ __qualname____doc__rstrrMrD LogRecordboolrU __classcell__rQs@rrIrIs~ )#)4))))))6W.6466666666rrI)gatewayhermes_plugins)agent run_agent model_tools batch_runner)tools) hermes_clicli)cron)zhermes_cli.web_serverzhermes_cli.pty_bridge tui_gatewayuvicorn)r_rarergrhgui) hermes_home log_level max_size_mb backup_countmodeforcerlrmrnrorprqc *|p t}|dz }|ddt\}} } |p|pd} t t | t j} |p| pddzdz} |p| pd}dd lm}t j }t||d z | | ||t t||d z t j d d|t |dkrIt||dz t jdd|tttd|dkrIt||dz t jdd|tttdtr|s|S|jt jks |j| kr|| t&D]3}t j |t j 4da|S)u@Configure the Hermes logging subsystem. Safe to call multiple times — the second call is a no-op unless *force* is ``True``. Parameters ---------- hermes_home Override for the Hermes home directory. Falls back to ``get_hermes_home()`` (profile-aware). log_level Minimum level for the ``agent.log`` file handler. Accepts any standard Python level name (``"DEBUG"``, ``"INFO"``, ``"WARNING"``). Defaults to ``"INFO"`` or the value from config.yaml ``logging.level``. max_size_mb Maximum size of each log file in megabytes before rotation. Defaults to 5 or the value from config.yaml ``logging.max_size_mb``. backup_count Number of rotated backup files to keep. Defaults to 3 or the value from config.yaml ``logging.backup_count``. mode Caller context: ``"cli"``, ``"gateway"``, ``"gui"``, ``"cron"``. When ``"gateway"``, an additional ``gateway.log`` file is created that receives only gateway-component records. When ``"gui"``, an additional ``gui.log`` file is created that receives dashboard and TUI-gateway component records. force Re-run setup even if it has already been called. Returns ------- Path The ``logs/`` directory where files are written. logsTparentsexist_okINFOirRedactingFormatterz agent.log)level max_bytesro formatterz errors.logi r_z gateway.logiP)r|r}ror~ log_filterrkzgui.logi)rmkdir_read_logging_configupperrrDrw agent.redactr{ getLogger_add_rotating_handler _LOG_FORMATWARNINGrICOMPONENT_PREFIXES_logging_initializedr|NOTSETsetLevel_NOISY_LOGGERS)rlrmrnrorprqhomelog_dir cfg_level cfg_max_size cfg_backup level_namer|r}backupsr{rootrSs r setup_loggingrsmX  +/++DVmG MM$M...+?*@*@'I|Z2y2F99;;J GZ 6 6E1 1T9D@I-j-AG0/////    D +$$[11  ,o!$$[11  y  m #,%((55'(:9(EFF     u}}  i ,&((55'(:5(ABB    E zW^##tzE'9'9 e::$((9999 Nrcddlm}tj}|jD]E}t |tjr)t |tst|ddrdSFtjt}| tj | |tdd|_|||jtj kr| tj t"D]3}tj| tj4tjd  tjdS) zEnable DEBUG-level console logging for ``--verbose`` / ``-v`` mode. Called by ``AIAgent.__init__()`` when ``verbose_logging=True``. rrz_hermes_verboseFNz%H:%M:%S)datefmtTz rex-deploy)rr{rDrhandlers isinstance StreamHandlerrrr%rDEBUG setFormatter_LOG_FORMAT_VERBOSEr addHandlerr|rrrw)r{rhhandlerrSs rsetup_verbose_loggingrBsf 0/////    D] a. / /  1FY8Z8Z q+U33 #LNN33G W]### ++,?TTTUUU"GOOG zGM!! gm$$$::$((9999 l##,,W\:::::rcjeZdZdZfdZdZd dZd dZdej ddffd Z fd Z fd Z xZ S) _ManagedRotatingFileHandleruRotatingFileHandler that ensures group-writable perms in managed mode AND survives external rotation. Two responsibilities: 1. In managed mode (NixOS), the stateDir uses setgid (2770) so new files inherit the hermes group. However, both ``_open()`` (initial creation) and ``doRollover()`` create files via ``open()``, which uses the process umask — typically 0022, producing 0644. This subclass applies ``chmod 0660`` after both operations so the gateway and interactive users can share log files. 2. ``RotatingFileHandler`` keeps an open file descriptor. If anything rotates the file *externally* (``logrotate``, manual ``mv``, another process rotating under us, a transient unlink), our fd keeps pointing at the renamed/unlinked inode and every subsequent write goes to ``gateway.log.1`` instead of ``gateway.log`` — silent log loss for the file every operator expects to read. Before each emit we ``stat`` ``baseFilename`` and compare it against the open stream's inode; on mismatch we reopen. This is the same pattern as stdlib ``WatchedFileHandler.reopenIfNeeded()``, adapted for rotating handlers. cddlm}||_tj|i|d|_d|_|dS)Nr) is_managed)hermes_cli.configr_managedrLrM _stat_dev _stat_ino_record_stream_stat)rPr>r?rrQs rrMz$_ManagedRotatingFileHandler.__init__sf000000"  $)&))))-(,   """""rcp|jr. tj|jddS#t$rYdSwxYwdS)Ni)roschmod baseFilenameOSError)rPs r_chmod_if_managedz-_ManagedRotatingFileHandler._chmod_if_managedsX =  *E22222      s % 33r2Nc tj|j}|j|jc|_|_dS#t$rd\|_|_YdSwxYw)zHSnapshot dev/ino of ``baseFilename`` so we can detect external rotation.)NNN)rstatrst_devst_inorrrrPsts rrz/_ManagedRotatingFileHandler._record_stream_stats` 8*++B-/Y *DNDNNN 8 8 8-7 *DNDNNNN 8s26AAc tj|j}n#t$r| |j|jn#t $rYnwxYwd|_ ||_|n#t $rYnwxYwYdSt$rYdSwxYw|j |j |j |j c|_ |_ dS|j |j f|j |j fkr |j|jn#t $rYnwxYwd|_ ||_|j |j c|_ |_ dS#t $rYdSwxYwdS)aaReopen the stream when ``baseFilename`` no longer matches our fd. Triggered when ``baseFilename`` was renamed (logrotate), unlinked, or replaced by a different inode. Silent + best-effort: any error falls back to the existing (possibly stale) stream so logging keeps working instead of dying on a stat failure. N)rrrFileNotFoundErrorr"r r!_openrrrrrrrs r_reopen_if_externally_rotatedz9_ManagedRotatingFileHandler._reopen_if_externally_rotateds *++BB     ;*K%%'''    DK "jjll ((****     FF    FF  > !T^%;-/Y *DNDN F Iry !dndn%E E E ;*K%%'''    DK "jjll 13BI.     F Es B. AB. AB.A B. -B B. BB.BB.! B.-B.9 D D'&D'22E&& E43E4r@c|j$tj|jr|t |dSr)r"rpathexistsrrrLemit)rPr@rQs rrz _ManagedRotatingFileHandler.emitsQ ; "bgnnT5F&G&G "  . . 0 0 0  Vrcpt}||Sr)rLrr)rPr"rQs rrz!_ManagedRotatingFileHandler._opens+     rct||dSr)rL doRolloverrr)rPrQs rrz&_ManagedRotatingFileHandler.doRolloversE        """""rr2N)rVrWrXrYrMrrrrDr[rrrr]r^s@rrrfs0#####8888////b7, #########rr)rloggerrr|r}r~rc|}|jD]N}t|tr7t t |dd|krdSO|jddtt|||d} | || ||| || | dS)aAdd a ``RotatingFileHandler`` to *logger*, skipping if one already exists for the same resolved file path (idempotent). Parameters ---------- log_filter Optional filter to attach to the handler (e.g. ``_ComponentFilter`` for gateway.log). rr NTrtr )maxBytes backupCountr )resolverrrrrparentrrrZrr addFilterr) rrr|r}ror~rresolvedexistingrs rrrs&||~~HO x!4 5 5 WX~r::;;CCEEQQ FFKdT222) D I<G U ###*%%% grc ddl}t}|rt|dd5}||pi}dddn #1swxYwY|di}t |tr>|d|d|d fSn#t$rYnwxYwd S) uBest-effort read of ``logging.*`` from config.yaml. Returns ``(level, max_size_mb, backup_count)`` — any may be ``None``. rNrr )r rDr|rnro)NNN) yamlrropen safe_loadgetrdictr!)r config_pathfcfglog_cfgs rrrs1   %''      k3999 .QnnQ''-2 . . . . . . . . . . . . . . .ggi,,G'4(( KK((KK ..KK//       s58CA CA""C%A"&A+C C C r)'rYrrDrr threadinglogging.handlersrpathlibrtypingrrhermes_constantsrrrlocalr5rrr%rrZr6r8rGFilterrIrintr\rrrLogger Formatterrrrrrrs:  000000%%%%%%%%======== #9?$$ O [D,-C-D----''''9999: !!! 6 6 6 6 6w~ 6 6 6$- B     *#'#!%"&uuu$u}u# u 3- u 3- u u uuuup;;;;Ht#t#t#t#t#"5t#t#t#~,0$$$ N$ $  $  $  $ $($ $$$$Nr