RoPE: How 2D Rotations Solved Transformer Long-Context
RoPE (Su et al., 2021) uses 2D rotations to encode position, enabling relative attention without breaking FlashAttention fusions.
Read more
AI NewsComputer VisionPyTorch
Meta's SAM 3 Enhances Segmentation Accuracy and Speed for Vision Workflows
Meta's SAM 3 improves segmentation accuracy and reduces inference latency for real-world vision tasks.
Read more
AI NewsGPU ComputingPyTorch
Easily Build and Share ROCm Kernels with Hugging Face
Hugging Face’s kernel-builder and kernels libraries streamline ROCm kernel development, enabling a Grand Prize-winning FP8 GEMM kernel to be shared with the community.
Read more
AI NewsAIML & Data Engineering
PyTorch Foundation Expands Open AI Infrastructure with Ray and Monarch
The PyTorch Foundation introduces Ray and PyTorch Monarch at its 2025 conference, advancing distributed AI infrastructure and promoting transparency in foundation model development.