PieSlicer: Dynamically Improving Response Time for Cloud-based CNN Inference

Samuel S. Ogden, Xiangnan Kong, Tian Guo

12th ACM/SPEC International Conference on Performance Engineering (ICPE'21)

project

The bottleneck for using cloud-based inference can come down to poor mobile or network performance. PieSlicer improves this performance by dynamically deciding where to preprocess the inference input based on empirical-driven performance models.

CINET: Redesigning Deep Neural Networks for Efficient Mobile-Cloud Collaborative Inference

Xin Dai, Xiangnan Kong, Tian Guo, Yixian Huang

SIAM International Conference on Data Mining (SDM'21)

project

We design a collaboration-aware neural network called CiNet by considering the low on-device computation and network transmission cost from the outset. CiNet allows easy and efficient inference computation partition across mobile device and remote server.

GRAD: Learning for Overhead-aware Adaptive Video Streaming with Scalable Video Coding

Yunzhuo Liu, Bo Jiang, Tian Guo, Ramesh Sitaraman, Don Towsley, Xinbing Wang

28th ACM International Conference on Multimedia (ACM MM'20)

paper , project

We provide a new mechanism for bitrate adaptation algorithms, enabling finer-grained bitrate adjustments to both buffered and incoming video chunks. Our deep reinforcement learning based approach outperforms state-of-the-art, especially under highly-variable network.

VVSec: Securing Volumetric Video Streaming via Benign Use of Adversarial Perturbation

Zhongze Tang, Xianglong Feng, Yi Xie, Huy Phan, Tian Guo, Bo Yuan, Sheng Wei

28th ACM International Conference on Multimedia (ACM MM'20)

paper , project

Demystifying the Placement Policies of the GPU Thread Block Scheduler for Concurrent Kernels

Guin R. Gilman, Samuel S. Ogden, Tian Guo, Robert J. Walls

38th International Symposium on Computer Performance, Modeling, Measurements and Evaluation (Performance'20)

paper , project

EPNet: Learning to Exit with Flexible Multi-Branch Network

Xin Dai, Xiangnan Kong, Tian Guo

ACM International Conference on Information and Knowledge Management (CIKM'20)

paper , project

PointAR: Efficient Lighting Estimation for Mobile Augmented Reality

Yiqin Zhao, Tian Guo

16th European Conference on Computer Vision (ECCV'20)

poster , paper , project

Few-shot Neural Architecture Search

Yiyang Zhao, Linnan Wang, Yuandong Tian, Rodrigo Fonseca, Tian Guo

arXiv (arXiv'20)

paper , project

Recurrent Networks for Guided Multi-Attention Classification

Xin Dai, Xiangnan Kong, Tian Guo, John Lee, Xinyue Liu, Constance Moore

ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD'20)

paper , project

QuRate: Power-Efficient Mobile Immersive Video Streaming

Nan Jiang, Yao Liu, Tian Guo, Wenyao Xu, Viswanathan Swaminathan, Lisong Xu, Sheng Wei

ACM Multimedia Systems Conference 2020 (MMSys'20) 🎉🎉 Best Paper, DASH-IF Excellence in DASH Award (3rd place) 🎉🎉

code , paper , project

Characterizing and Modeling Distributed Training with Transient Cloud GPU Servers

Shijian Li, Robert J. Walls, Tian Guo

40th IEEE International Conference on Distributed Computing Systems (ICDCS'20)

code , paper , project

DistStream: An Order-Aware Distributed Framework for Online-Offline Stream Clustering Algorithms

Lijie Xu, Xingtong Ye, Kai Kang, Tian Guo, Wensheng Dou, Wei Wang, Jun Wei

40th IEEE International Conference on Distributed Computing Systems (ICDCS'20)

paper , project

PointAR: Efficient Lighting Estimation for Mobile Augmented Reality

Yiqin Zhao, Tian Guo

International Workshop on Mobile Computing Systems and Applications (HotMobile'20)

paper , project

Perseus: Characterizing Performance and Cost of Multi-Tenant Serving for CNN Models

Matthew LeMay, Shijian Li, Tian Guo

IEEE International Conference on Cloud Engineering (IC2E'20)

code , paper , project

MDInference: Balancing Inference Accuracy and Latency for Mobile Applications

Samuel S. Ogden, Tian Guo

IEEE International Conference on Cloud Engineering (IC2E'20)

code , paper , project

Challenges and Opportunities of DNN Model Execution Caching

Guin R. Gilman, Samuel S. Ogden, Robert J. Walls, Tian Guo

Third Workshop on Distributed Infrastructures for Deep Learning (DIDL'19)

project

Speeding up Deep Learning with Transient Servers

Shijian Li, Robert J. Walls, Lijie Xu, Tian Guo

The 16th IEEE International Conference on Autonomic Computing (ICAC'19)

code , paper , project