unweave.io
platform engineer, mlops, contract · berlin · june to july 2023.
impact
- four features in a month: multi-node and multi-gpu instances, shared volumes, git repository sync, and the build configurations for kubernetes-managed vms.
- sftp data transfer 75% faster through compression, both ways. copying between a laptop and a remote directory got faster with it.
- the work is public. the cli and the api took the pull requests under my name, from ssh key handling and volumes to the multi-gpu instance types.
the organisation
unweave is a berlin startup. it makes gpu access as simple as a command: an mlops platform that streamlines cloud tenant deployments for training. its cli and api are open on github.
what i did
the cli and the api, feature by feature. golang, terraform, aws, postgresql, the kubernetes and docker apis.
what it meant
i shipped a feature a week into someone else’s open codebase. it was my first step from data into mlops. it was fun.
sources
- unweave/cli and unweave/unweave-v1, the pull requests, may to june 2023: ssh keys, volumes, multi-gpu instances, faster copying.