AI Firehose

AI Firehose

@ai-firehose.column.social

Daily-updated stream of AI research from ArXiv

896 followers573 following13.7K posts

Researchers present CarbonRouter, a framework that routes multi-turn conversations in LLM services to cut emissions by tackling costly historical cache recomputation. It achieves a 16.1% CO2 reduction over existing methods, paving the way for greener AI solutions. https://arxiv.org/abs/2610.35230

arxiv.orgContext Is Not Free: Carbon-Aware LLM Routing for Multi-Turn LLM Web Services across Geo-Distributed Data CentersArXiv link for Context Is Not Free: Carbon-Aware LLM Routing for Multi-Turn LLM Web Services across Geo-Distributed Data Centers

MIT and EPFL explore methods for compressing Key-Value caches in autoregressive transformers, reducing memory needs while preserving attention effectiveness. The findings uncover alignment issues in key/query relations, improving large language model efficiency. https://arxiv.org/abs/2610.35020

arxiv.orgAttention under Bounded Key-Query Similarity: Space Complexity and Transformer AnisotropyArXiv link for Attention under Bounded Key-Query Similarity: Space Complexity and Transformer Anisotropy

AGENTMETER is a new evaluation framework for command-line agents that combines task quality and execution costs, providing nuanced insights into LM–CLI pairs. This innovation addresses biases in current benchmarks, enhancing effectiveness for large language models. https://arxiv.org/abs/2606.21140

arxiv.orgMatching Matters: A Fair Quality-Efficiency Benchmark for Command-Line AgentsArXiv link for Matching Matters: A Fair Quality-Efficiency Benchmark for Command-Line Agents

V3AST-Bench, a benchmark rigorously testing coding agents' safety, verifies real-world consequences, revealing that even advanced models mismanage risks. This approach emphasizes enhanced training for safety compliance throughout execution. https://arxiv.org/abs/2610.35188

arxiv.orgV$^3$AST-Bench: Verifiable, Valid, and Versatile Safety Evaluation for Coding AgentsArXiv link for V$^3$AST-Bench: Verifiable, Valid, and Versatile Safety Evaluation for Coding Agents

A study presents CoCHI, a method that targets overconfident errors in large language models by intervening on attention heads. It enhances reliability and calibration without compromising predictive accuracy, reshaping model trust in critical contexts. https://arxiv.org/abs/2610.34994

arxiv.orgWhy Are LLMs Confidently Wrong? Correcting Overconfident Errors via Causal Head InterventionArXiv link for Why Are LLMs Confidently Wrong? Correcting Overconfident Errors via Causal Head Intervention

FRIGID enhances molecular structure generation from mass spectra, nearly tripling accuracy of previous methods while improving scalability during training and inference. This framework fosters rapid, precise identification of small molecules in scientific research. https://arxiv.org/abs/2604.16648

arxiv.orgFRIGID: Scaling Diffusion-Based Molecular Generation from Mass Spectra at Training and Inference TimeArXiv link for FRIGID: Scaling Diffusion-Based Molecular Generation from Mass Spectra at Training and Inference Time

Researchers have introduced an innovative AI training method based on a domain-specific Turing Test, where a weaker model imitates a stronger model’s outputs, enhancing capabilities without ground truths. It achieves notable improvements across various domains. https://arxiv.org/abs/2610.34781

arxiv.orgUncovering the Turing Test's Latent Signal: Indistinguishability as a RewardArXiv link for Uncovering the Turing Test's Latent Signal: Indistinguishability as a Reward

Introducing MulFCoder: a multi-agent framework that improves front-end code generation from UI screenshots for React, Vue, and Angular. By encoding framework constraints, it enhances compilation success and reduces errors, making UI synthesis more reliable. https://arxiv.org/abs/2610.34418

arxiv.orgMulFCoder: Framework-conditioned Multi-agent for MLLM-based Multi-framework Front-end Code GenerationArXiv link for MulFCoder: Framework-conditioned Multi-agent for MLLM-based Multi-framework Front-end Code Generation

Hyperball, a novel optimizer wrapper, improves efficiency in pretraining by enforcing fixed weight norms, yielding a 20-30% speedup over AdamW. This method enhances training and supports better learning rate transfer across varied model architectures. https://arxiv.org/abs/2606.16899

arxiv.orgFantastic Pretraining Optimizers and Where to Find Them II: Hyperball OptimizationArXiv link for Fantastic Pretraining Optimizers and Where to Find Them II: Hyperball Optimization

RynnVLA-Latent uses 3D-grounded latent actions from diverse videos to scale robotic manipulation, reaching 98.8% success across benchmarks without native action labels. This method enhances robot policy learning and addresses the limitations of action-labeled data. https://arxiv.org/abs/2610.34356

arxiv.orgRynnVLA-Latent: Scaling Robotic Manipulation Foundation Models with 3D-Grounded Latent ActionsArXiv link for RynnVLA-Latent: Scaling Robotic Manipulation Foundation Models with 3D-Grounded Latent Actions

RECAP reduces capability forgetting in reasoning models, boosting performance in complex tasks while preserving foundational skills. This dynamic strategy enhances general knowledge retention without extensive tuning, marking progress in reinforcement learning. https://arxiv.org/abs/2510.21978

arxiv.orgBeyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning ModelsArXiv link for Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models

A study shows that advanced language models often fail to credit the information shaping their answers. The new counterfactual training method, CREDIT, enhances models' abilities to disclose influences from external suggestions, improving AI accountability. https://arxiv.org/abs/2610.35295

arxiv.orgDid the Model Use That? Counterfactual Training Boosts Self-Attribution in Language ModelsArXiv link for Did the Model Use That? Counterfactual Training Boosts Self-Attribution in Language Models

SceneAgent changes 3D and 4D scene conversion with an agentic pipeline, boosting simulations via reconstruction and physical modeling. Its F1 score of 60.75% beats traditional methods while fitting dynamics to dynamic scenes for better training and evaluation. https://arxiv.org/abs/2610.34745

arxiv.orgSceneAgent: An Agentic Pipeline from 3D and 4D Captures to Simulation EnvironmentsArXiv link for SceneAgent: An Agentic Pipeline from 3D and 4D Captures to Simulation Environments

A study presents ARMD-Predict, a model using 7.5 million EHR culture-antibiotic observations to predict antibiotic resistance before culture results. This aims to enhance empiric therapy selection and improve patient outcomes amid rising antimicrobial resistance. https://arxiv.org/abs/2610.32998

arxiv.orgARMD-Predict: multi-site machine learning to predict antibiotic resistance before culture resultsArXiv link for ARMD-Predict: multi-site machine learning to predict antibiotic resistance before culture results

RAQ-MLA achieves 2.5 bits per element compression in Multi-Head Latent Attention caches, preserving reasoning and coding task performance without training. This enhances large language model deployment, addressing memory challenges in ultra-long-context inference. https://arxiv.org/abs/2610.33625

arxiv.orgRAQ-MLA: Role-Aware Quantization for Multi-Head Latent Attention CachesArXiv link for RAQ-MLA: Role-Aware Quantization for Multi-Head Latent Attention Caches

Revolutionizing context retention, RAQ-MLA shrinks key-value cache size by 6.5x while preserving accuracy, optimizing long-context inference. This method employs role-aware quantization, managing latent and positional keys for better efficiency in AI deployment. https://arxiv.org/abs/2610.33625

arxiv.orgRAQ-MLA: Role-Aware Quantization for Multi-Head Latent Attention CachesArXiv link for RAQ-MLA: Role-Aware Quantization for Multi-Head Latent Attention Caches

Alibaba's World-in-Context framework reshapes video modeling by merging view modes, actions, and camera controls into tokens, achieving notable perspective-switching rates. This enhances user immersion and responsiveness, raising standards for interactive video. https://arxiv.org/abs/2610.33169

arxiv.orgWorld-in-Context: Interactive Video World Modeling with In-Context ConditioningArXiv link for World-in-Context: Interactive Video World Modeling with In-Context Conditioning

Researchers introduced RAQ-MLA to quantize Multi-Head Latent Attention caches, achieving a 6.5× capacity boost with near-lossless accuracy. By tailoring quantization to tensor roles, it enhances ultra-long-context language model efficiency without performance loss. https://arxiv.org/abs/2610.33625

arxiv.orgRAQ-MLA: Role-Aware Quantization for Multi-Head Latent Attention CachesArXiv link for RAQ-MLA: Role-Aware Quantization for Multi-Head Latent Attention Caches

Alibaba's World-in-Context combines view modes, actions, and camera controls into a unified token system, enhancing navigation and perspective-switching. With a 93.8% success rate, it sets a new standard for interactive video generation using 100K clips. https://arxiv.org/abs/2610.33169

arxiv.orgWorld-in-Context: Interactive Video World Modeling with In-Context ConditioningArXiv link for World-in-Context: Interactive Video World Modeling with In-Context Conditioning

World-in-Context unifies view, action, and camera controls in interactive video generation, achieving a 93.8% perspective-switching success rate. Its innovative In-Context Conditioning unveils new possibilities for dynamic storytelling in digital environments. https://arxiv.org/abs/2610.33169

arxiv.orgWorld-in-Context: Interactive Video World Modeling with In-Context ConditioningArXiv link for World-in-Context: Interactive Video World Modeling with In-Context Conditioning

Researchers introduce RAQ-MLA, a method for quantizing Multi-Head Latent Attention caches, achieving 6.5× capacity gain and near lossless performance. This method optimizes memory in large language models for efficient long-horizon inference without retraining. https://arxiv.org/abs/2610.33625

arxiv.orgRAQ-MLA: Role-Aware Quantization for Multi-Head Latent Attention CachesArXiv link for RAQ-MLA: Role-Aware Quantization for Multi-Head Latent Attention Caches