Hybrid cloud setups, combining on-premises datacenters and public cloud resources, have become increasingly common as enterprises seek scalability, flexibility, and cost benefits. However, this strategy introduces significant challenges, especially regarding where to store data …
Paper submission volumes have been increasing in recent years. Submissions to the largest ML conferences have grown 2-4x in just the last 3 years! Conferences and journals have to maintain the scale of peer review, even as it may become infeasible for program chairs and editors to assess reviewers’ expertise. Many conferences have adopted automated paper-reviewer assignment systems to cope with increasing submission volumes. In contrast, most journals continue to match papers to reviewers manually. This post is about automating journal paper-reviewer assignment.
Advances in generative models have made it possible for AI-generated text, code, and images to mirror human-generated content in many applications. A critical question is: How can people accurately detect if a piece of text is AI-generated?
Watermarking is a promising solution…
Flow matching models like Stable Diffusion 3.5 and FLUX generate an image by iteratively denoising random noise over many small steps. When we want to fine-tune these models with reinforcement learning, say to make them follow text prompts more faithfully or produce more aestheti…
Figure 1: Colocated serving versus heterogeneous operator-level disaggregated serving.
Large language model inference demand is rising quickly, and the infrastructure spending required to serve that demand is rising with it. Market analyses and industry reports increasingly p…
Homomorphic encryption (HE) is a powerful cryptographic technique that enables computation on encrypted data.
With HE, we can create privacy-preserving machine learning models that navigate privacy laws and tap into the computational power of an untrusted cloud.
However, practica…
In this blog, we explain the recent progress on an important class of stochastic sequential decision problems, called restless bandits, based on our paper Unichain and aperiodicity are sufficient for asymptotic optimality of average-reward restless bandits.
We will also briefly m…
Suppose I ask a text-to-image model for a peacock eating rice. The model may know what a peacock looks like. It may know what rice looks like. It may even know how a chicken pecks at rice. But if the training data never contained the exact composition peacock + rice, why should t…
Computer architecture determines how programs execute in hardware—how work unfolds over time and across resources.
Most readers are familiar with processors through the Von Neumann model, where programs are executed as sequences of instructions.
In this view, execution appears s…
Workload imbalance is one of the major problems in training long-context Large Language Model (LLM) models. Long-context capability — the ability of a model to process and reason over hundreds of thousands of tokens at once — is critical for applications such as repository-level …
