FastForward
a learning-oriented log forwarder exploring modern Rust, SIMD parsing, Arrow columnar storage, and formal verification
Use It
BenchmarksLoading benchmark data…Quick StartInstall, run your first pipeline, and ship logs in 15 minutesSQL TransformsSELECT, WHERE, GROUP BY, JOINs, UDFs — full SQL on every batchInput TypesFile, TCP, UDP, OTLP, HTTP, Arrow IPC, sensor, generatorOutput TypesOTLP, Elasticsearch, Loki, stdout, file, TCP, UDP, Arrow IPCYAML ReferenceEvery config field, input/output option, and server settingDeploy to KubernetesDaemonSet config, resource sizing, and collector integrationTroubleshootingDiagnose pipeline stalls, checkpoint issues, and output errorsUnderstand It

TailingWatch FastForward handle rotation and truncation live — inode tracking, offset resets, atomic checkpoints

Scanner & Field PushdownStep through SIMD JSON parsing, then toggle fields to see how pushdown cuts bytes and boosts throughput

Backpressure in ActionSlide output speed to slow or outage — watch pressure cascade from outputs back to the file reader

Columnar StorageCompare row vs column layout and see why Arrow makes SQL transforms essentially free

Checkpoint OrderingStep through out-of-order ACKs and see why the committed watermark can never skip an unresolved batch