USENIX
USENIX
  • 5 466
  • 4 292 638
NSDI '24 - Horus: Granular In-Network Task Scheduler for Cloud Datacenters
NSDI '24 - Horus: Granular In-Network Task Scheduler for Cloud Datacenters
Parham Yassini, Simon Fraser University; Khaled Diab, Hewlett Packard Labs; Saeed Zangeneh and Mohamed Hefeeda, Simon Fraser University
Short-lived tasks are prevalent in modern interactive datacenter applications. However, designing schedulers to assign these tasks to workers distributed across the whole datacenter is challenging, because such schedulers need to make decisions at a microsecond scale, achieve high throughput, and minimize the tail response time. Current task schedulers in the literature are limited to individual racks. We present Horus, a new in-network task scheduler for short tasks that operates at the datacenter scale. Horus efficiently tracks and distributes the worker state among switches, which enables it to schedule tasks in parallel at line rate while optimizing the scheduling quality. We propose a new distributed task scheduling policy that minimizes the state and communication overheads, handles dynamic loads, and does not buffer tasks in switches. We compare Horus against the state-of-the-art in-network scheduler in a testbed with programmable switches as well as using simulations of datacenters with more than 27K hosts and thousands of switches handling diverse and dynamic workloads. Our results show that Horus efficiently scales to large datacenters, and it substantially outperforms the state-of-the-art across all performance metrics, including tail response time and throughput.
View the full NSDI '24 program at www.usenix.org/conference/nsdi24/technical-sessions
Переглядів: 345

Відео

NSDI '24 - Fast Vector Query Processing for Large Datasets Beyond GPU Memory with Reordered...
Переглядів 28814 днів тому
NSDI '24 - Fast Vector Query Processing for Large Datasets Beyond GPU Memory with Reordered Pipelining Zili Zhang, Fangyue Liu, Gang Huang, Xuanzhe Liu, and Xin Jin, School of Computer Science, Peking University Vector query processing powers a wide range of AI applications. While GPUs are optimized for massive vector operations, today's practice relies on CPUs to process queries for large vect...
NSDI '24 - Towards Intelligent Automobile Cockpit via A New Container Architecture
Переглядів 10514 днів тому
NSDI '24 - Towards Intelligent Automobile Cockpit via A New Container Architecture Lin Jiang and Feiyu Zhang, Xi’an Yunzhiji Technology; Jiang Ming, Tulane University An intelligent cockpit is now crucial in automobiles, not just to provide digital instrumentation and in-vehicle controls but also to offer a wide range of entertainment functionalities. To cater to the demands of these intelligen...
NSDI '24 - Sifter: An Inversion-Free and Large-Capacity Programmable Packet Scheduler
Переглядів 6714 днів тому
NSDI '24 - Sifter: An Inversion-Free and Large-Capacity Programmable Packet Scheduler Peixuan Gao, Anthony Dalleggio, Jiajin Liu, and Chen Peng, New York University; Yang Xu, Fudan University; H. Jonathan Chao, New York University Packet schedulers play a crucial role in determining the order in which packets are served. They achieve this by assigning a rank to each packet and sorting them base...
NSDI '24 - LoLKV: The Logless, Linearizable, RDMA-based Key-Value Storage System
Переглядів 15514 днів тому
NSDI '24 - LoLKV: The Logless, Linearizable, RDMA-based Key-Value Storage System Ahmed Alquraan and Sreeharsha Udayashankar, University of Waterloo; Virendra Marathe, Oracle Labs; Bernard Wong and Samer Al-Kiswany, University of Waterloo We present LoLKV, a novel logless replicated key-value storage system. LoLKV follows a fundamentally different approach for designing a linearizable key-value ...
NSDI '24 - Jolteon: Unleashing the Promise of Serverless for Serverless Workflows
Переглядів 6814 днів тому
NSDI '24 - Jolteon: Unleashing the Promise of Serverless for Serverless Workflows Zili Zhang, Chao Jin, and Xin Jin, School of Computer Science, Peking University Serverless computing promises automatic resource provisioning to relieve the burden of developers. Yet, developers still have to manually configure resources on current serverless platforms to satisfy application-level requirements. T...
NSDI '24 - Pudica: Toward Near-Zero Queuing Delay in Congestion Control for Cloud Gaming
Переглядів 11314 днів тому
NSDI '24 - Pudica: Toward Near-Zero Queuing Delay in Congestion Control for Cloud Gaming Shibo Wang, Xi’an Jiaotong University and Tencent Inc.; Shusen Yang, Xi'an Jiaotong University; Xiao Kong, Chenglei Wu, and Longwei Jiang, Tencent; Chenren Xu, Peking University; Cong Zhao, Xi'an Jiaotong University; Xuesong Yang, Bonree; Jianjun Xiao and Xin Liu, Tencent; Changxi Zheng, Pixel Lab, Tencent ...
NSDI '24 - Revisiting Congestion Control for Lossless Ethernet
Переглядів 11214 днів тому
NSDI '24 - Revisiting Congestion Control for Lossless Ethernet Yiran Zhang, Tsinghua University and Beijing University of Posts and Telecommunications; Qingkai Meng, Tsinghua University and Beihang University; Chaolei Hu and Fengyuan Ren, Tsinghua University Congestion control is a key enabler for lossless Ethernet at scale. In this paper, we revisit this classic topic from a new perspective, i...
NSDI '24 - Autothrottle: A Practical Bi-Level Approach to Resource Management for SLO-Targeted...
Переглядів 10414 днів тому
NSDI '24 - Autothrottle: A Practical Bi-Level Approach to Resource Management for SLO-Targeted Microservices Zibo Wang, University of Science and Technology of China and Microsoft Research; Pinghe Li, ETH Zurich; Chieh-Jan Mike Liang, Microsoft Research; Feng Wu, University of Science and Technology of China; Francis Y. Yan, Microsoft Research Awarded Outstanding Paper! Achieving resource effic...
NSDI '24 - Flow Scheduling with Imprecise Knowledge
Переглядів 15114 днів тому
NSDI '24 - Flow Scheduling with Imprecise Knowledge Wenxin Li, Xin He, Yuan Liu, and Keqiu Li, Tianjin University; Kai Chen, Hong Kong University of Science and Technology and University of Science and Technology of China; Zhao Ge and Zewei Guan, Tianjin University; Heng Qi, Dalian University of Technology; Song Zhang, Tianjin University; Guyue Liu, New York University Shanghai Most existing da...
NSDI '24 - Making Kernel Bypass Practical for the Cloud with Junction
Переглядів 35214 днів тому
NSDI '24 - Making Kernel Bypass Practical for the Cloud with Junction Joshua Fried and Gohar Irfan Chaudhry, MIT CSAIL; Enrique Saurez, Esha Choukse, and Íñigo Goiri, Azure Research - Systems; Sameh Elnikety, Microsoft Research; Rodrigo Fonseca, Azure Research - Systems; Adam Belay, MIT CSAIL Kernel bypass systems have demonstrated order of magnitude improvements in throughput and tail latency ...
NSDI '24 - Can't Be Late: Optimizing Spot Instance Savings under Deadlines
Переглядів 14614 днів тому
NSDI '24 - Can't Be Late: Optimizing Spot Instance Savings under Deadlines Zhanghao Wu, Wei-Lin Chiang, Ziming Mao, and Zongheng Yang, University of California, Berkeley; Eric Friedman and Scott Shenker, University of California, Berkeley, and ICSI; Ion Stoica, University of California, Berkeley Awarded Outstanding Paper! Cloud providers offer spot instances alongside on-demand instances to opt...
NSDI '24 - Cloudcast: High-Throughput, Cost-Aware Overlay Multicast in the Cloud
Переглядів 4914 днів тому
NSDI '24 - Cloudcast: High-Throughput, Cost-Aware Overlay Multicast in the Cloud
NSDI '24 - iStack: A General and Stateful Name-based Protocol Stack for Named Data Networking
Переглядів 3114 днів тому
NSDI '24 - iStack: A General and Stateful Name-based Protocol Stack for Named Data Networking
NSDI '24 - The Bedrock of Byzantine Fault Tolerance: A Unified Platform for BFT Protocols...
Переглядів 5514 днів тому
NSDI '24 - The Bedrock of Byzantine Fault Tolerance: A Unified Platform for BFT Protocols...
NSDI '24 - SwiftPaxos: Fast Geo-Replicated State Machines
Переглядів 6514 днів тому
NSDI '24 - SwiftPaxos: Fast Geo-Replicated State Machines
NSDI '24 - A large-scale deployment of DCTCP
Переглядів 7914 днів тому
NSDI '24 - A large-scale deployment of DCTCP
NSDI '24 - Harmony: A Congestion-free Datacenter Architecture
Переглядів 16814 днів тому
NSDI '24 - Harmony: A Congestion-free Datacenter Architecture
NSDI '24 - MuCache: A General Framework for Caching in Microservice Graphs
Переглядів 7214 днів тому
NSDI '24 - MuCache: A General Framework for Caching in Microservice Graphs
NSDI '24 - TECC: Towards Efficient QUIC Tunneling via Collaborative Transmission Control
Переглядів 4814 днів тому
NSDI '24 - TECC: Towards Efficient QUIC Tunneling via Collaborative Transmission Control Jiaxing Zhang, Alibaba Group, University of Chinese Academy of Sciences; Furong Yang, Alibaba Group; Ting Liu, Alibaba Group, University of Chinese Academy of Sciences; Qinghua Wu, University of Chinese Academy of Sciences, Purple Mountain Laboratories, China; Wu Zhao, Yuanbo Zhang, Wentao Chen, Yanmei Liu,...
NSDI '24 - Understanding Routable PCIe Performance for Composable Infrastructures
Переглядів 8014 днів тому
NSDI '24 - Understanding Routable PCIe Performance for Composable Infrastructures Wentao Hou, University of Wisconsin-Madison; Jie Zhang and Zeke Wang, Zhejiang University; Ming Liu, University of Wisconsin-Madison Routable PCIe has become the predominant cluster interconnect to build emerging composable infrastructures. Empowered by PCIe non-transparent bridge devices, PCIe transactions can tr...
NSDI '24 - Alea-BFT: Practical Asynchronous Byzantine Fault Tolerance
Переглядів 7914 днів тому
NSDI '24 - Alea-BFT: Practical Asynchronous Byzantine Fault Tolerance Diogo S. Antunes, Afonso N. Oliveira, André Breda, Matheus Guilherme Franco, Henrique Moniz, and Rodrigo Rodrigues, Instituto Superior Técnico (ULisboa) and INESC-ID Traditional Byzantine Fault Tolerance (BFT) state machine replication protocols assume a partial synchrony model, leading to a design where a leader replica driv...
NSDI '24 - GRACE: Loss-Resilient Real-Time Video through Neural Codecs
Переглядів 3514 днів тому
NSDI '24 - GRACE: Loss-Resilient Real-Time Video through Neural Codecs
NSDI '24 - BBQ: A Fast and Scalable Integer Priority Queue for Hardware Packet Scheduling
Переглядів 11914 днів тому
NSDI '24 - BBQ: A Fast and Scalable Integer Priority Queue for Hardware Packet Scheduling
NSDI '24 - Gemino: Practical and Robust Neural Compression for Video Conferencing
Переглядів 4614 днів тому
NSDI '24 - Gemino: Practical and Robust Neural Compression for Video Conferencing
NSDI '24 - Brain-on-Switch: Towards Advanced Intelligent Network Data Plane via NN-Driven Traffic...
Переглядів 4114 днів тому
NSDI '24 - Brain-on-Switch: Towards Advanced Intelligent Network Data Plane via NN-Driven Traffic...
NSDI '24 - The Eternal Tussle: Exploring the Role of Centralization in IPFS
Переглядів 2114 днів тому
NSDI '24 - The Eternal Tussle: Exploring the Role of Centralization in IPFS
NSDI '24 - MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurations
Переглядів 4914 днів тому
NSDI '24 - MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurations
NSDI '24 - LiFteR: Unleash Learned Codecs in Video Streaming with Loose Frame Referencing
Переглядів 2614 днів тому
NSDI '24 - LiFteR: Unleash Learned Codecs in Video Streaming with Loose Frame Referencing
NSDI '24 - Sirius: Composing Network Function Chains into P4-Capable Edge Gateways
Переглядів 3614 днів тому
NSDI '24 - Sirius: Composing Network Function Chains into P4-Capable Edge Gateways

КОМЕНТАРІ

  • @Mrperusyaneko
    @Mrperusyaneko 8 днів тому

    thank you for this great work. interestring "The more ML model learns, the easier to be fooled", also we need to pay attention to this threat.

  • @adenyo462
    @adenyo462 14 днів тому

    I just want to point out that today, 12 years later, IPv6 is still indeed optional 🤣

  • @lilefevertical
    @lilefevertical 15 днів тому

    Interesting.

  • @thepianist7379
    @thepianist7379 19 днів тому

    At 5:45, how do attackers know that x is a property and then tamper with it?

  • @ricp
    @ricp 28 днів тому

    This is a great, and the concept of $ cost of decisions made in the game it's a great concept! I've tried the "Labtainers" created by this same author, team, and those are great for Cybersecurity hands-on practice

  • @vivek2319
    @vivek2319 Місяць тому

    My two cents - if the research or work is done by a team of three, it's not a good practice for one person to give the entire presentation alone. Everyone should contribute.

  • @petermarshall8750
    @petermarshall8750 Місяць тому

    Your formula for the area of a parallelogram is incorrect. It should be A = S*W*sin(angle)

  • @coochiedestroyerr
    @coochiedestroyerr Місяць тому

    no idea why my college decided to include this in our "Cloud computing" subject ??

  • @vanshjangir_
    @vanshjangir_ Місяць тому

    At 25:23 how does the decapsulation happens on the L7 load balancer.

  • @user-mr5hq8md1z
    @user-mr5hq8md1z Місяць тому

    Bruh this vid had literally no comment 😂

  • @mjdxp5688
    @mjdxp5688 Місяць тому

    Fork Oracle!

  • @InabaNitohbe
    @InabaNitohbe 2 місяці тому

    Hello, is your project code open source?

  • @alexkaouris6755
    @alexkaouris6755 2 місяці тому

    very nice.

  • @TheLinuxGallery-qz2vs
    @TheLinuxGallery-qz2vs 2 місяці тому

    9 years later, and the community is trying to phase out FFS for ZFS, without regard for the issues Dr Marshall McKusick talks about, with mirroring filesystems. I can't find tools for using any BSD filesystem in linux, except for ZFS. I can barely find meaningful resources on the subject; and any help I'm offered for my laptops and desktops and routers and external drives, amounts to "use ZFS" or "you don't want to use FFS, use ext4 or ZFS" or "UFS is bad, use ZFS", or "you need ext4 or better, ZFS" or "*ignores question about implimenting FFS* ZFS is really cool, you should try ZFS". And then, I'm instantly shunned.

  • @killerferplay614
    @killerferplay614 2 місяці тому

    Why am I getting this? Type: LA_NFCID1 (7), Value: 0x0E014790D2422E Type: LA_SEL_INFO, Value: 0x20 Type: LA_BIT_FRAME_SDD, Value: 0x44 Type: LA_PLATFORM_CONFIG, Value: 0x00 Type: LA_HIST_BY (3),

  • @jr.snowkai9493
    @jr.snowkai9493 2 місяці тому

    Very nice presentation.

  • @vineetbhargava4141
    @vineetbhargava4141 2 місяці тому

    Thanks Chip for explaining definitely going to read the paper.

  • @MadushanNishantha
    @MadushanNishantha 2 місяці тому

    Interesting project and results. nice!. Also take a look at rutabaga_gfx(fully supported in crosvm, and partial support in qemu). most recent versions support command serialization at the kernel api level(drm calls in linux). Basically they run a copy of the host gpu driver in the guest, and just submit the kernel calls to the host. this way, the user-space graphics stack is fully isolated from the host, and also has a reduction of api call numbers, and they use drm fences for synchronization. they also claim near native graphics performance on chromeos for their android compatibility layer. the feature is called "virtgpu drm native context"

  • @yosihashamen1
    @yosihashamen1 2 місяці тому

    Finally a good explanation

  • @openclass4all
    @openclass4all 2 місяці тому

    Great presentation @usenix

  • @JJGhostHunters
    @JJGhostHunters 3 місяці тому

    Very interesting work! Can you provide the CNN coding that was used for key extraction?

  • @Abu_khalid1
    @Abu_khalid1 3 місяці тому

    That's interesting

  • @user-el4cw3of2i
    @user-el4cw3of2i 3 місяці тому

    this is really interesting

  • @rogeryau8798
    @rogeryau8798 3 місяці тому

    really cool that the jobs can be run on spot instances across clouds

  • @yairmorgenstern416
    @yairmorgenstern416 3 місяці тому

    Genuinely better than most professional comedians

  • @The-KP
    @The-KP 3 місяці тому

    Brilliant.. as usual. I'd like to hire James Menckin to deliver the eulogy at my funeral, but I'm afraid he'll take my family on a road trip to save the planet from Rust.

  • @forheuristiclifeksh7836
    @forheuristiclifeksh7836 3 місяці тому

    1:00

  • @forheuristiclifeksh7836
    @forheuristiclifeksh7836 3 місяці тому

    1:00

  • @terrylawrence3726
    @terrylawrence3726 3 місяці тому

    This presentation is too technical and very monotonous. I would have preferred something more live than someone reading a scripts. Thank you for sharing...

  • @OverLord3693
    @OverLord3693 3 місяці тому

    A good short video on sampling

  • @user-zw2td4jq4f
    @user-zw2td4jq4f 3 місяці тому

    Content is wrong... plz update this video

  • @user-w0806x
    @user-w0806x 4 місяці тому

    I'd like to know how the probability values for each field are determined at the 10:06 mark in the video.

  • @victorsmirnov876
    @victorsmirnov876 4 місяці тому

    Cool!

  • @fiberplz
    @fiberplz 4 місяці тому

    This sounds like an incredibly fun project. Many questions remain to be answered, but I enjoyed the presentation.

  • @HarshTandon-kn6md
    @HarshTandon-kn6md 4 місяці тому

    Great Talk!

  • @dannychapman9167
    @dannychapman9167 4 місяці тому

    Mine all surfaces

  • @dannychapman9167
    @dannychapman9167 4 місяці тому

    Tools Nunn

  • @dannychapman9167
    @dannychapman9167 4 місяці тому

    Titt Titt y tutti tutti

  • @julietibshirani6052
    @julietibshirani6052 4 місяці тому

    Fantastic talk, thank you!

  • @julietibshirani6052
    @julietibshirani6052 4 місяці тому

    I had trouble understanding the argument as to why queueing theory is hard to apply in practice. Many systems provide metrics for the average service time (or even quantiles of service time) and queue length. And the "hockey stick" curve is indeed unintuitive, but this is exactly why theory is so helpful in wrapping your head around what's happening.

  • @cheese-power
    @cheese-power 4 місяці тому

    13:54 this is wrong. Power scales with frequency quadratically (or cubically when DVFS is considered) but scales linearly with time. Therefore, in this case, the total amount of energy consumed should stay approximately the same.

  • @ltdestiny970
    @ltdestiny970 4 місяці тому

    Can't understand you with a mask on :/

  • @ahan9048
    @ahan9048 4 місяці тому

    nice share

  • @user-fy5ph6ft6p
    @user-fy5ph6ft6p 4 місяці тому

    says he is going to unravel csi operations then proceeds to skip it :(

  • @jannekorhonen6263
    @jannekorhonen6263 4 місяці тому

    Great work!

  • @RAGHAV4882
    @RAGHAV4882 4 місяці тому

    This is so cool. I was wondering if this project is still actively being developed on and it's applications that I was looking into. Also, A Question: Hardware compatibility support: curious what things/hardwares are currently not supported that trinity hopes to cover later in the future? Question 2: I wonder what's modem support is like (Or if windows/mac even have option/pipelines to pass in the OS in the first place for an emulator to pick up on!).

  • @chaitanyachaitu4094
    @chaitanyachaitu4094 5 місяців тому

    Where can I get the Power point Presentation for this video.

  • @AndreRosario-zm8pf
    @AndreRosario-zm8pf 5 місяців тому

    2001 illegal wire taps. No warnt on wire taps. 2016 Due process violation. A constitution right. 2019 Entrapment. No warnt on wire

  • @zn4q3oi18zx
    @zn4q3oi18zx 5 місяців тому

    5:20

  • @adewumisunkanmi5593
    @adewumisunkanmi5593 5 місяців тому

    This is Fantastic!