Building the Chesapeake Bay Bridge-Tunnel (2014)

web.archive.org
building-the-chesapeake-bay-bridge-tunnel-(2014)

Any construction site is dangerous, but building in swells and currents required a unique blend of vigilance and derring-do. Transfers between boats, barges and the growing bridge presented a frequent danger. Captains could not always nose their crafts neatly against … Read more

Building Meta’s GenAI Infrastructure

engineering.fb.com
building-meta’s-genai-infrastructure

Marking a major investment in Meta’s AI future, we are announcing two 24k GPU clusters. We are sharing details on the hardware, network, storage, design, performance, and software that help us extract high throughput and reliability for various AI workloads. … Read more

Building a Deep Learning Rig

samsja.github.io
building-a-deep-learning-rig

03 february, 2024 I just got my hands on a mining rig with 3 rtx 3090 founder edition for the modest sum of 1.7k euros. My plan is to transform it into a deep learning ring, to finetune and serve … Read more

Building an LLM from Scratch: Automatic Differentiation

bclarkson-code.github.io
building-an-llm-from-scratch:-automatic-differentiation

Setup from typing import Any, Optional, List import networkx as nx LLM from scratch: Automatic Differentiation I’m building a modern language model with all the bells and whistles completely from scratch: from vanilla python to functional coding assistant. Borrowing (shamelessly … Read more