Publications

2024

Graph Neural Networks Automated Design and Deployment on Device-Edge Co-Inference Systems
Ao Zhou, Jianlei Yang, Tong Qiao, Yingjie Qi, Zhi Yang, Weisheng Zhao and Chunming Hu
The 61th Design Automation Conference (DAC '24) , 2024

X-former Elucidator: Reviving Efficient Attention for Long Context Language Modeling
Xupeng Miao, Shenhan Zhu, Fangcheng Fu, Ziyu Guo and Zhi Yang, Yaofeng Tu, Zhihao Jia, Bin Cui
The International Joint Conference on Artificial Intelligence (IJCAI '24), 2024

NC-ALG: Graph-based Active Learning under Noisy Crowd
Wentao Zhang, Yexin Wang, Zhenbang You, Yang Li, Gang Cao, Zhi Yang, Bin Cui
IEEE International Conference on Data Engineering (ICDE), 2024

2023

Welder: Scheduling Deep Learning Memory Access via Tile-graph
Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
The 17th USENIX Symposium on Operating Systems Design and Implementation (OSDI '23), 2023

Grinder: Analysis and Optimization for Dynamic Control Flow in Deep Learning
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
The 17th USENIX Symposium on Operating Systems Design and Implementation (OSDI '23), 2023

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters
Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou
The European Conference on Computer Systems (EuroSys), 2023

Scapin: Scalable Graph Perturbation by Augmented Influence Maximization
Yexin Wang, Zhi Yang, Junqi Liu, Wentao Zhang, Bin Cui
ACM SIGMOD International Conference on Management of Data (SIGMOD), 2023

GoldMiner: Elastic Scaling of Training Data Pre-Processing Pipelines for Deep Learning
Hanyu Zhao, Zhi Yang, Yu Cheng, Chao Tian, Shiru Ren, Wencong Xiao, Man Yuan, Langshi Chen, Kaibo Liu, Yang Zhang, Yong Li, and Wei Lin
ACM SIGMOD International Conference on Management of Data (SIGMOD), 2023

SDPipe: A Semi-Decentralized Framework for Heterogeneity-aware Pipeline-parallel Training
Xupeng Miao, Yining Shi,  Zhi Yang,  Bin Cui and Zhihao Jia
The 49th International Conference on Very Large Data Bases (VLDB), 2023

Graph-Enforced Neural Network for Attributed Graph Clustering
Zeang Sheng, Wentao Zhang, Yang Li, Wen Ouyang, Yangyu Tao, Zhi Yang and Bin Cui
The 7th APWeb-WAIM International Joint Conference on Web and Big Data (APWeb-WAIM), 2023, Best Paper Runner Up Award

2022

NAFS: A Simple yet Tough-to-beat Baseline for Graph Representation Learning
Wentao Zhang, Zeang Sheng, Mingyu Yang, Yang Li, Yu Shen, Zhi Yang, Bin Cui
The 39th International Conference on Machine Learning (ICML), 2022

Deep and Flexible Graph Neural Architecture Search
Wentao Zhang, Zheyu Lin, Yu Shen, Yang Li, Zhi Yang, Bin Cui
The 39th International Conference on Machine Learning (ICML), 2022

An Empirical Study of Deep Graph Neural Networks
Wentao Zhang, Zeang Sheng, Yuezihan Jiang, Yikuan Xia, Jun Gao, Zhi Yang, Bin Cui
SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD), 2022

Graph Attention Multi-Layer Perceptron
Wentao Zhang, Ziqi Yin, Zeang Sheng, Wen Ouyang, Xiaosen Li, Yangyu Tao, Zhi Yang, Bin Cui
SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD), 2022

TransBO : Hyperparameter optimization via Two-Phase Transfer Learning
Yang Li, Yu Shen, Huaijun Jiang, Wentao Zhang, Zhi Yang, Ce Zhang, Bin Cui
SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD), 2022

HET-GMP: a Graph-based System Approach to Scaling Large Embedding Model Training
Xupeng Miao, Yining Shi, Hailin Zhang, Xin Zhang, Xiaonan Nie, Zhi Yang, Bin Cui
International Conference on Management of Data (SIGMOD), 2022

Information Gain Propagation: a New Way to Graph Active Learning with Soft Labels
Wentao Zhang, Yexin Wang, Zhenbang You, Meng Cao, Ping Huang, Jiulong Shan, Zhi Yang, Bin Cui
International Conference on Learning Representations (ICLR), 2022

PASCA: a New Paradigm and System to Build Scalable Graph Neural Network
Wentao Zhang, Yu Shen, Zheyu Lin, Yang Li, Xiaosen Li, wen ouyang, Yangyu Tao, Zhi Yang, Bin Cui
The Web Conference (WWW), 2022, Best Student Paper Award

HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework
Xupeng Miao, Hailin Zhang, Yining Shi, Xiaonan Nie, Zhi Yang, Yangyu Tao, Bin Cui
International Conference on Very Large Data Bases (VLDB), 2022, Best Scalable Data Science Paper

TSPLIT: Enabling Holistic Deep Learning Memory System Optimization with Tensor Splitting
Xiaonan Nie, Xupeng Miao, Zhi Yang, Bin Cui
IEEE International Conference on Data Engineering (ICDE), 2022

Zoomer: Improving and Accelerating Recommendation on Web-Scale Graphs via Regions of Interests
Yuezihan Jiang, Yu Cheng, Hanyu Zhao, Wentao Zhang, Xupeng Miao, Yu He, Liang Wang, Zhi Yang, Bin Cui
IEEE International Conference on Data Engineering (ICDE), Industry Track, 2022

AMCAD: Adaptive Mixed-Curvature Representation based Advertisement Retrieval System
Zhirong Xu, Shiyang Wen, Junshan Wang, Guojun Liu, Liang Wang, Zhi Yang, Lei Ding, Yan Zhang, Di Zhang, Jian Xu, Bo Zheng
IEEE International Conference on Data Engineering (ICDE), Industry Track, 2022

2021

RIM: Reliable Influence-based Active Learning on Graphs
Wentao Zhang, Yexin Wang, Zhenbang You, Meng Cao, Ping Huang, Jiulong Shan, Zhi Yang, Bin Cui
Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS), 2021, Spotlight.

Node Dependent Local Smoothing for Scalable Graph Learning
Wentao Zhang, Mingyu Yang, Zeang Sheng, Yang Li, Wen Ouyang, Yangyu Tao, Zhi Yang, Bin Cui
Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS), 2021, Spotlight.

Grain: Improving Data Efficiency of Graph Neural Networks via Diversified Influence Maximization
Wentao Zhang, Zhi Yang, YeXin Wang, Yu Shen, Yang Li , Liang Wang, Bin Cui
International Conference on Very Large Data Bases (VLDB), 2021

VolcanoML: Speeding up End-to-End AutoML via Scalable Search Space Decomposition
Yang Li, Yu Shen, Wentao Zhang, Jiawei Jiang, Bolin Ding, Yaliang Li, Jingren Zhou, Zhi Yang, Wentao Wu, Ce Zhang and Bin Cui
International Conference on Very Large Data Bases (VLDB), 2021

OpenBox: A Generalized Black-box Optimization Service
Yang Li, Yu Shen, Wentao Zhang, Yuanwei Chen, Huai Jun Jiang, Ming Chao Liu, Jiawei Jiang, Jinyang Gao, Wentao Wu, Zhi Yang, Ce Zhang, Bin Cui
KDD (Applied Data Science), 2021

ROD: Reception-aware Online Distillation for Sparse Graphs
Wentao Zhang, Jiang Yuezihan, Yang Li, Zeang Sheng, Yu Shen, Xupeng Miao, Liang Wang, Zhi Yang, Bin Cui
KDD, 2021

ALG: Fast and Accurate Active Learning Framework for Graph Convolutional Networks
Wentao Zhang, Yu Shen, Yang Li, Lei Chen, Zhi Yang, Bin Cui
International Conference on Management of Data (SIGMOD), 2021

Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce
Xupeng Miao, Xiaonan Nie, Yingxia Shao, Zhi Yang, Jiawei Jiang, Lingxiao Ma, Bin Cui
International Conference on Management of Data (SIGMOD), 2021

CuWide:Towards Efficient Flow-based Training for Sparse Wide Models on GPUs
Xupeng Miao,Lingxiao Ma, Zhi Yang, Yingxia Shao, Bin Cui, Lele Yu, Jiawei Jiang
IEEE Transactions on Knowledge and Data Engineering (TKDE), 2021

SMAD: Scalable Multi-view Ad Retrieval System for ECommerce Sponsored Search
Shiyang Wen, Yiran Chen, Zhi Yang, Yan Zhang, Di Zhang, Liang Wang, Bo Zheng
The 30th ACM International Conference on Information and Knowledge Management (CIKM), 2021

2020

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui , Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI '20), 2020

HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees
Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Francis C.M. Lau, Yuqi Wang, Yifan Xiong, Bin Wang
the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI '20), 2020

PCGCN: Partition-Centric Processing for Accelerating Graph Convolutional Network
Chao Tian, Lingxiao Ma, Zhi Yang, Yafei Dai
The 34th IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2020

TrustGCN: Enabling Graph Convolutional Network for Robust Sybil Detection in OSNs
Yue Sun, Zhi Yang, Yafei Dai
IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), 2020

2019

Autor3: Automated Real-time Ranking with Reinforcement Learning in Ecommerce Sponsored Search Advertising
Yusi Zhang, Zhi Yang, Liang Wang, and Li He
The 28th ACM International Conference on Information and Knowledge Management (CIKM), 2019

ScheD2: Scheduling Deep Learning Training via Deep Reinforcement Learning
Yunteng Luan, Xukun Chen, Hanyu Zhao, Zhi Yang, Yafei Dai
IEEE Global Communications Conference (GlobeCom), 2019

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs
Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
USENIX Annual Technical Conference (USENIX ATC), 2019

SeerNet: Predicting Convolutional Neural Network Feature-Map Sparsity through Low-Bit Quantization
Shijie Cao, Lingxiao Ma, Wencong Xiao, Chen Zhang, Yunxin Liu, Lintao Zhang, Lanshun Nie, Zhi Yang
30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019

2018

SDPaxos: Building Efficient Semi-Decentralized Geo-replicated State Machines
Hanyu Zhao, Quanlu Zhang, Zhi Yang, Ming Wu and Yafei Dai
ACM Symposium on Cloud Computing 2018 (SoCC), 2018

A Game Theoretic Model For The Formation of Navigable Small-world Networks--The Tradeoff Between Distance And Reciprocity
Zhi Yang, Wei Chen
to be appeared in ACM Transactions on Internet Technology (TOIT), 2018

DeepCredit: Clickstream-based model for loan Risk Prediction in P2P Lending
Zhi Yang, Yusi Zhang, Binghui Guo, Ben Zhao and Yafei Dai
International AAAI Conference on Web and Social Media (ICWSM), 2018

Defending against Social Network Sybils with Interaction Graph Embedding
Zhi Yang, Yusi Zhang and Yafei Dai
International IEEE Conference on Communications and Network Security (CNS), 2018

Proactive Video Push for Optimizing Bandwidth Consumption in Hybrid CDN-P2P VoD Systems
Yuanxing Zhang, Chengliang Gao, Yangze Guo, Kaigui Bian, Xin Jin, Zhi Yang, Lingyang Song, Jiangang Cheng, Hu Tuo, and Xiaoming Li
IEEE International Conference on Computer Communications (INFOCOM), 2018

ATDPS: An Adaptive Time-Dependent Push Strategy in Hybrid CDN-P2P VoD System
Yangze Guo, Yuanxing Zhang, Zhi Yang, Kaigui Bian, Hu Tuo and Yafei Dai
International In proceedings of IEEE ICC (ICC), 2018

2017

Garaph: Efficient GPU-accelerated Graph Processing on a Single Machine with Balanced Replication
Lingxiao Ma, Zhi Yang, Han Chen, Jilong Xue, Yafei Dai
USENIX Annual Technical Conference (USENIX ATC), 2017

BCStore: Bandwidth-Efficient In-memory KV-Store with Batch Coding
Shenglong Li, Quanlu Zhang, Zhi Yang, Yafei Dai
International Conference on Massive Storage Systems and Technology (MSST), 2017

DeltaCFS: Boosting Delta Sync for Cloud Storage Services by Learning from NFS
Quanlu Zhang, Zhenhua Li, Zhi Yang, Shenglong Li, Yangze Guo, Yafei Dai
IEEE International Conference on Distributed Computing Systems (ICDCS), 2017

2016

Efficient Distributed Machine Learning with Trigger Driven Parallel Training
Shenglong Li,Jilong Xue, Zhi Yang, Yafei Dai
IEEE Global Communications Conference (GlobeCom), 2016

Processing Concurrent Graph Analytics with Decoupled Computation Model
Jilong Xue, Zhi Yang, Shian Hou, Yafei Dai
IEEE Transaction On Computer (TOC), 2016

2015

VoteTrust: Leveraging Friend Invitation Graph to Defend against Social Network Sybils
Zhi Yang, Jilong Xue, Xiaoyong Yang, Xiao Wang, Yafei Dai
IEEE Transactions on Dependable and Secure Computing (TDSC), 2015

Understanding and Surpassing Dropbox: Efficient Incremental Synchronization in Cloud Storage Services
Shenglong Li, Quanlu Zhang, Zhi Yang, and Yafei Dai
IEEE Global Communications Conference (GlobeCom), 2015

When Graph Computation Meets Heterogeneous Cluster
Jilong Xue, Zhi Yang, Shian Hou, Yafei Dai
IEEE International Conference on Big Data (BigData), 2015

Process-driven Analysis of Dynamics in Online Social Interactions
Zhi Yang, Jilong Xue, Christo Wilson, Ben Y. Zhao, and Yafei Dai
ACM Conference on Online Social Networks (COSN), 2015

A game theoretic model for the formation of navigable small-world networks
Zhi Yang and Wei Chen
International World Wide Web Conference (WWW), 2015

CHARM: A Cost-efficient Multi-cloud Data Hosting Scheme with High Availability
Quanlu Zhang, Shenglong Li, Zhenhua Li, Yuanjian Xing, Zhi Yang, and Yafei Dai
IEEE Transaction on Cloud Computing (TCC), 2015

Uncovering User Interaction Dynamics in Online Social Networks
Zhi Yang, Jilong Xue, Christo Wilson, Ben Y. Zhao, and Yafei Dai
International AAAI Conference on Weblogs and Social Media (ICWSM), 2015

2014

Uncovering Social Network Sybils in the Wild
Zhi Yang , Christo Wilson, Xiao Wang, Tingting Gao, Ben Y. Zhao and Yafei Dai
ACM Transactions on Knowledge Discovery from Data (TKDD), 2014

Seraph: an Efficient, Low-cost System for Concurrent Graph Processing
Jilong Xue, Zhi Yang , Zhi Qu, Shian Hou, Yafei Dai
23nd International ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC), 2014

Understanding the Performance of Offline Download in Real P2P Networks
Zhi Yang ,Yuanjian Xing,Chi Chen,Yafei Dai
Int'J of Peer-to-Peer Networking and Applications, 2014

Before 2013

Seraph: An Efficient System for Parallel Processing on a Shared Graph
Zhi Yang , Jilong Xue, Zhi Qu, Shian Hou, Yafei Dai
7th Workshop on Large-Scale Distributed Systems and Middleware (LADIS), 2013

VoteTrust: Leveraging Friend Invitation Graph to Defend against Social Network Sybils
Jilong Xue, Zhi Yang, Xiaoyong Yang, Xiao Wang, Lijiang Chen, Yafei Dai
32nd Annual IEEE International Conference on Computer Communications (INFOCOM), 2013

PROB: a Lightweight Approach for Fast Content Propagation in P2P Networks
Zhi Yang and Yafei Dai
IEEE Thirteen International Conference on Peer-to-Peer Computing (P2P), 2013

Beehive: Low-cost Content Subscription Service using Cloudlets
YuanJian Xing, Zhi Yang, Chi Chen, Yafei Dai
SCIENCE CHINA Information Sciences, 2013

Uncovering Social Network Sybils in the Wild
Zhi Yang , Christo Wilson, Xiao Wang, Tingting Gao, Ben Y. Zhao and Yafei Dai
11th ACM SIGCOMM Internet Measurement Conference (IMC), 2011

Protector: a Probabilistic Failure Detector for Cost-effective Peer-to-Peer Storage,
Zhi Yang , Jing Tian, Ben Y. Zhao, Wei Chen, Yafei Dai
IEEE Transactions on Parallel and Distributed Systems (TPDS), 2011

On the QoS of Offline Download in Retrieving Peer-side File Resource
Yuanjian Xing, Zhi Yang, Chi Chen, Jilong Xue and Yafei Dai
40th International Conference on Parallel Processing (ICPP), 2011

Exploring Peer Heterogeneity: Towards Understanding and Application
Zhi Yang , Yuanjian Xing, Feng Xiao, Zhi Qu, Xiaoming Li and Yafei Dai
11th International Conference on Peer-to-Peer Computing(P2P), 2011

AutoProc: An Automatic Proactive Replication Scheme for P2P Storage
Zhi Yang and Yafei Dai
SCIENCE CHINA Information Sciences, 2011

AmazingStore: Available, Low-cost Online Storage Service Using Cloudlets
Zhi Yang , Ben Y. Zhao, Yuanjian Xing, Song Ding, Feng Xiao and Yafei Dai
9th International Workshop on P2P Systems (IPTPS), 2010

Towards a More Accurate Availability Evaluation in Peer-to-Peer Storage Systems
Zhi Yang, Jing Tian and Yafei Dai.
Int. J. High Performance Computing and Networking, 2010

Exploring cost-availability tradeoff in P2P storage system
Zhi Yang, Yafei Dai and Xiao Zhen.
38th International Conference on Parallel Processing(ICPP), 2009

The Neutralizer: a Self-Configurable Failure Detector for Minimizing Distributed Storage Maintenance Cost
Zhi Yang, Yafei Dai and Xiaoming Li..
In Concurrency and Computation: Practice and Experience, 2009

Exploring cost-availability tradeoff in P2P storage system
Jing Tian, Zhi Yang, Wei Chen, Ben Y. Zhao, Yafei Dai.
27th International Symposium on Reliable Distributed Systems(SRDS), 2008

A Data Placement Scheme with Time-Related Model for P2P Storages
Jing Tian, Zhi Yang and Yafei Dai
7th International Conference on Peer-to-Peer Computing(P2P), 2007

Towards a More Accurate Availability Evaluation in Peer-to-Peer Storage Systems
Zhi Yang, Jing Tian and Yafei Dai
IEEE International Conference on Networking, Architecture and Storage(NAS), 2006