AI's Electron.JS Moment?
Published on
by 
James Ravenscroft
The study provides an analysis of ML model energy usage on a state of the art nvidia chip:
We ran all of our experiments on a single NVIDIA A100-SXM4-80GB GPU
Read more...
Our transition from AWS to bare-metal infrastructure underscores the fact that while cloud services such as AWS offer robust flexibility and power, they may not always be the most economical choice for every enterprise.
Neel Patel, https://blog.oneuptime.com/moving-from-aws-to-bare-metal/
We had a very similar experience at my current company a few years ago and we're saving similar magnitudes of cash. Rather than going full bare metal we have a hybrid IT strategy where staging and production systems are hosted in Google Cloud with all of the advantages that brings (redundancy, flexibility, security) but we use our own hardware for running test environments and CI workloads. Our source code repo is cloud-based for the redundancy after, true story, our old gitlab instance was literally melted in the OVH fire, March 2021.
Read more...