YjdZddlmZddlZddlZddlZddlmZmZm Z m Z ddl m Z m Z ejeZGddZddddZddZddZdS)z+SSE (Server-Sent Events) parsing utilities.) annotationsN)AsyncGenerator AsyncIterable GeneratorIterable)Anycastc`eZdZdZddZeddZdd Zdd Zd d ddZ ddZ ddZ dS)SSEStreamParsera  Incrementally parse an SSE byte stream into content strings. This parser is designed for real network streaming where byte chunks may split UTF-8 codepoints and/or split lines arbitrarily. It maintains: - An incremental UTF-8 decoder to safely decode across chunk boundaries. - A text buffer to safely assemble complete lines across chunk boundaries. The Honcho streaming format is expected to include lines in the form `data:` or `data: `. Each data line should contain a JSON object with: - `done: true` to indicate stream completion. - `delta.content` containing incremental text. Any JSON decoding failures are logged with the same warning format as the legacy parser, including a preview of the data payload. returnNonechtjdd|_d|_d|_dS)Nzutf-8replace)errorsF)codecsgetincrementaldecoder_decoder _text_buffer_doneselfs W/home/ubuntu/.hermes/hermes-agent/venv/lib/python3.11/site-packages/honcho/utils/sse.py__init__zSSEStreamParser.__init__"sD4 63O 4 4 444 "$  boolc|jS)z6Whether the stream has emitted a `done: true` message.)rrs rdonezSSEStreamParser.done)s zrchunkbytesGenerator[str, None, None]c#K|js|sdS|j|d}|r|xj|z c_|Ed{VdS)aH Feed the next bytes from the SSE stream and yield any newly available content. Args: chunk: Raw bytes from the SSE stream. Yields: Content strings extracted from any complete `data:` lines decoded from this chunk (and any previously buffered partial data). NFfinalrrdecoder_drain_complete_lines)rrdecodeds rfeedzSSEStreamParser.feed.s~ : U  F-&&uE&::  )    (  --///////////rc#K|jrdS|jdd}|r|xj|z c_|dEd{VdS)z Finalize the stream and yield any remaining content. This should be called once the underlying byte stream is finished to flush any remaining decoder/buffer state. NrTr# flush_partialr%)rr(s rfinalizezSSEStreamParser.finalizeBs| :  F-&&s$&77  )    (  --D-AAAAAAAAAAArFr+r,c#K|js>||}|dS||Ed{V|j> >>>D|((.. . . . . . . . * / / / / /r str | Nonec|jsdS|jd}|jd}|dkr|dkr|sdS|j}d|_|S|dkr|}n|dkr|}nt||}|j|}|dkrG|jd|}|j|dzd|_|dr |dd}|S|t |jdz kr|sdS|dzt |jkr<|j|dzdkr(|jd|}|j|dzd|_|S|jd|}|j|dzd|_|S)N  r)rfindminendswithlen)rr,idx_nidx_rr1idxseps rr/zSSEStreamParser._pop_line[s  4!&&t,,!&&t,, B;;5B;;  t$D "D K B;;CC b[[CCeU##C$ $;;$TcT*D $ 1#')) >!!!!!!!{{5!!!!!!!!!!!rchunksIterable[bytes]c#Kt}|D]'}||Ed{V|jrdS(|Ed{VdS)z Parse an SSE byte stream and yield content strings. Args: chunks: An iterable of raw byte chunks from an SSE stream. Yields: Content strings extracted from delta objects, in order. Nr r)rr-)rbr]rs rparse_sse_streamrfs  F;;u%%%%%%%%% ;  FF            rAsyncIterable[bytes]AsyncGenerator[str, None]cKt}|23d{V}||D]}|WV|jrdS/6|D]}|WVdS)z Parse an async SSE byte stream and yield content strings. Args: chunks: An async iterable of raw byte chunks from an SSE stream. Yields: Content strings extracted from delta objects, in order. Nre)rbr]rrEs rparse_sse_astreamrjs  Fe{{5))  GMMMMM ;  FF  ??$$ sA)rr r]r^r r!)rbrcr r!)rbrgr rh)rZ __future__rrrIloggingcollections.abcrrrrtypingrr getLoggerrWrOr rarfrjr\rrrps 11"""""" NNNNNNNNNNNN  8 $ $UUUUUUUUr7;""""""6!!!!$r