lake-orm

· opensource

lake-orm and the datalake-go projects.

what i did

a lakehouse is just parts; these are the parts in go. lake-orm is a typed orm over spark connect for databricks, delta lake and apache iceberg tables: Query[T] with projection pushdown, typed dataframe scans, streaming rows, inserts through a staging writer, migrations as struct diffs in goose format. around it, the maintained fork of spark’s go client with streaming, typed dataframes and gRPC transport options; lake-goose, goose-compatible migrations for delta and iceberg over spark sql; lake-k8s, a helm chart and a pre-baked spark connect image; lake-dashboard, a running-queries view; and lakehouse, the assembly. the roadmaps are public on each tracker.

sources