Hivemind
A library to train large neural networks across the internet. Imagine training one huge transformer on thousands of computers from universities, companies, and volunteers.
Links:
- What is hivemind all about? Here's a 3-minute read or a full paper
- Quickstart tutorial - install hivemind, set up a server and train experts
- Documentation & guides: learning-at-home.readthedocs.io
- Want to contribute? take a look at the issues or join our chat room
- Developer's guide: best practices, tests and performance benchmarks
- Related projects and acknowledgements
@NeCTAR-RC / 
