Infrastructure

Practical reporting on AI systems, tools, and engineering execution.

ORBIT: Self-hosted OpenAI-compatible gateway for private RAG and tool-using agents

ORBIT is a self-hosted backend that exposes an OpenAI-compatible API to route local or hosted models to YAML-configured data adapters, built-in admin tooling, and browser demos for private RAG and agents.

Git repo

October 12, 2026 2m

AgentOS — TypeScript agents with persistent memory, runtime tool forging, and multi-agent orchestration

AgentOS is an open-source TypeScript framework for long-running AI agents: cognitive memory with decay, runtime JavaScript tool forging, multi-agent patterns, and a single dispatch surface across 13 LLM providers.

Git repo

October 12, 2026 2m

MIRA — single-threaded conversational agent with first‑person memories and decay-based memory management

MIRA is an experimental assistant that maintains one continuous conversation, compresses older context into first‑person memory traces, and offers tools for stable documents and semantic memory recall.

Git repo

October 12, 2026 2m

FiftyOne — open-source tooling to inspect and improve visual datasets and models

FiftyOne provides an interactive App and Python APIs to visualize, label, and evaluate computer-vision datasets and models, with pip install and a source build that requires Node/Yarn for the UI.

Git repo

October 12, 2026 2m

Lance — open lakehouse file & table format for multimodal AI on object storage

Lance is an open lakehouse format that stores multimodal datasets on object storage with vector+text search, fast random access, ACID versioning, and Arrow/Pandas/DuckDB integrations for ML and search workloads.

Git repo

October 12, 2026 2m

SIE — Superlinked Inference Engine: single-cluster inference for many open models

SIE is an open-source inference engine that exposes OpenAI-compatible endpoints and runs 100+ open models in a single self-hosted cluster with Kubernetes deployment artifacts and preconfigured model catalog.

Git repo

October 12, 2026 2m

LangChain4j — an idiomatic Java library for building LLM-powered JVM apps

LangChain4j provides a unified, Java-first API for LLMs, embeddings, and common LLM application patterns with documentation, examples, and framework integrations; it aims to simplify swapping providers and assembling RAG/agent flows.

Git repo

October 12, 2026 2m

Qdrant — Rust vector database and similarity search (server, Edge, clients)

Qdrant is a Rust-written vector database and similarity search engine with server and in-process Edge modes, multiple official clients, and a managed cloud — suitable for building semantic search and recommendation services.