Work

yosoi

Year: 2026
Type: software
Abstract: Async-Native Pipeline Rewrote core pipeline to be async-native with full concurrent URL processing Unified sequential and concurrent pipeline configs/runtimes Added async iterators and YosoiContainer for streaming results Custom async Yosoi event bus for inter-component communication Async tenacity retry support Contracts Nested & scoped contracts — define sub-schemas with their own root selectors First-class contract components with root config (see examples/eshop) Dynamic contracts — build contracts at runtime Added force flag to ys.config and per-field selector overrides Custom Types (ys.*) New BaseType system with coercion and validation Built-in types: Price, Rating, Title, Author, BodyText, Url, DateTime Migrated CLI config and defaults to use ys.* types Custom typed stubs for ys.* imports; reduced Any usage throughout Providers & Models Added Cerebras, OpenRouter (including free models) support YOSOI_MODEL env var resolver for default model selection OPENROUTER_KEY env var support Automagic .env loading for LLM providers ys.providers magic strings for model provider selection in CLI Model fallback logic Selector Improvements Selector escalation — tiered selector levels, escalates on failure Snapshots — selectors store richer metadata List support — selectors can now target list/collection elements Changed empty selector fields from "NA" string to null Removed token cap (previously 30k) Output Formats Added XLSX, CSV, JSONL, Parquet output types (alongside existing JSON/Markdown) CLI Upgraded to rich + click styling Per-URL and total elapsed time in Live progress view Contract registry with fuzzy finder/helper Renamed --schema arg to --contract Conditional prompting based on contract shape Better organized CLI internals YosoiAgent New YosoiAgent wrapper with structured input Pydantic-validated agent I/O Observability Selector tracking added to stats.json Time elapsed added to pipeline output and stats.json Codecov integration added to CI CI matrix builds across Python versions Bug Fixes & Internals Content store hashing to avoid overwriting duplicate URL stores Fixed concurrency and caching bugs in CLI and pipeline Fixed NA fallback in selectors Fixed body text extraction spacing between adjacent inline elements Fixed rounding of elapsed time display Replaced HTML extractor with parsel for robustness Refactored file/directory structure for 0.1 readiness Removed legacy multimodal extractor and Playwright dependency Stricter mypy configuration PR list Killers of the Ticket Moon by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/21 Citation by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/23 Hot take by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/29 Some housekeeping by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/30 Dynamic contracts, Yosoi Types, and QoL by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/36 Test cookaging by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/42 Async Restructuing; CLI style upgrades by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/44 Expand parsing selectors by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/47 made .env loading more automagic for LLM providers by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/48 Mini calls by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/52 Thread safety and chores by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/54 Staging by @AndrewPBerg in https://github.com/CascadingLabs/Yosoi/pull/46 Full Changelog: https://github.com/CascadingLabs/Yosoi/compare/0.0.1a9...0.0.1a10
Language: English
Open Access status: green
OpenAlex ID: W7130693003
Cites:
Cited by:
Related to: 10