Skip to content

研究

未发表的工作只写到想法层面。细节、数字和代码等发表之后再放。

CMUin progress卡内基梅隆大学语言技术研究所,Li Lab· 2026

面向同声传译的无参考数据合成

Haoling Pu, and collaborators

边听边译意味着必须提前做出承诺。这项工作对源语言的后续内容做多种合理预测,据此判断此刻哪些内容可以安全输出,而无需参考译文。

展开(英文)↓

Simultaneous speech translation has to produce output before the speaker finishes. Commit too early and the translation bets on the wrong future; wait too long and latency defeats the purpose.

The idea: instead of one guess about how the sentence ends, consider many plausible continuations and only emit the target tokens that hold up across them. The training data for this behavior is synthesized without human reference translations.

Method details, numbers, and figures will appear here once the work is public.

competitionNVIDIA MLSys 2026 竞赛· 2026

Blackwell 优化的稀疏注意力算子

Haoling Pu

面向 DeepSeek 风格稀疏注意力、运行在 NVIDIA B200 上的 CUDA 算子。通过了竞赛的全部负载,比 PyTorch 参考实现快几十倍。

展开(英文)↓

IO-aware fusion, Tensor Core pipelining, and per-workload autotuning applied to sparse attention for long-context inference. See the project page for the breakdown.