no code implementations • 5 Jun 2024 • Li Yang, Anushya Subbiah, Hardik Patel, Judith Yue Li, Yanwei Song, Reza Mirghaderi, Vikram Aggarwal
Another difficulty is user interaction signals often have a different pattern from natural language text, and it is currently unclear if the LLM training setup can learn more non-trivial knowledge from interaction signals compared with traditional recommender system methods.
1 code implementation • 29 May 2024 • Zhaoliang Zhang, Tianchen Song, YongJae lee, Li Yang, Cheng Peng, Rama Chellappa, Deliang Fan
Recently, 3D Gaussian Splatting (3DGS) has become one of the mainstream methodologies for novel view synthesis (NVS) due to its high quality and fast rendering speed.
1 code implementation • 25 Apr 2024 • Fatemeh Dehrouyeh, Li Yang, Firouz Badrkhani Ajaei, Abdallah Shami
As technology advances, the use of Machine Learning (ML) in cybersecurity is becoming increasingly crucial to tackle the growing complexity of cyber threats.
no code implementations • 1 Apr 2024 • Li Yang, Zhipeng Luo, Shiming Zhang, Fei Teng, Tianrui Li
We believe this survey can help relevant researchers quickly familiarize themselves with the current state of continual learning research used in smart city development and direct them to future research trends.
no code implementations • 18 Mar 2024 • Li Yang, WU Ruizheng, LI Jiyong, CHEN Ying-cong
Supervised by polarization priors, this representation guides the learning of geometry behind the specular reflection and captures more details than existing methods.
no code implementations • 3 Mar 2024 • Jiao Ding, Jie Chang, Renrui Han, Li Yang
Accurate segmentation of COVID-19 CT images is crucial for reducing the severity and mortality rates associated with COVID-19 infections.
no code implementations • 1 Mar 2024 • Shiming Zhang, Zhipeng Luo, Li Yang, Fei Teng, Tianrui Li
Our survey offers a comprehensive review of route recommendation work based on urban computing.
no code implementations • 29 Jan 2024 • Shuxun Wang, Yunfei Lei, Ziqi Zhang, Wei Liu, Haowei Liu, Li Yang, Wenjuan Li, Bing Li, Weiming Hu
With the rise of 'Metaverse' and 'Web3. 0', NFT ( Non-Fungible Token ) has emerged as a kind of pivotal digital asset, garnering significant attention.
no code implementations • 1 Jan 2024 • Yulin Shao, Chenghong Bian, Li Yang, Qianqian Yang, Zhaoyang Zhang, Deniz Gunduz
Acquisition and processing of point clouds (PCs) is a crucial enabler for many emerging applications reliant on 3D spatial data, such as robot navigation, autonomous vehicles, and augmented reality.
no code implementations • 7 Dec 2023 • Mirna El Rajab, Li Yang, Abdallah Shami
The Zero-touch network and Service Management (ZSM) framework represents an emerging paradigm in the management of the fifth-generation (5G) and Beyond (5G+) networks, offering automated self-management and self-healing capabilities to address the escalating complexity and the growing data volume of modern networks.
1 code implementation • 17 Nov 2023 • Rémy Sun, Li Yang, Diane Lingrand, Frédéric Precioso
While HDMaps are a crucial component of autonomous driving, they are expensive to acquire and maintain.
no code implementations • 6 Nov 2023 • Yunlong Chen, Yaming Zhang, Jianfei Yu, Li Yang, Rui Xia
However, generating the most appropriate knowledge base query code based on Natural Language Questions (NLQ) poses a significant challenge in KBQA.
no code implementations • 8 Oct 2023 • Tianyang Zhong, Wei Zhao, Yutong Zhang, Yi Pan, Peixin Dong, Zuowei Jiang, Xiaoyan Kui, Youlan Shang, Li Yang, Yaonai Wei, Longtao Yang, Hao Chen, Huan Zhao, Yuxiao Liu, Ning Zhu, Yiwei Li, Yisong Wang, Jiaqi Yao, Jiaqi Wang, Ying Zeng, Lei He, Chao Zheng, Zhixue Zhang, Ming Li, Zhengliang Liu, Haixing Dai, Zihao Wu, Lu Zhang, Shu Zhang, Xiaoyan Cai, Xintao Hu, Shijie Zhao, Xi Jiang, Xin Zhang, Xiang Li, Dajiang Zhu, Lei Guo, Dinggang Shen, Junwei Han, Tianming Liu, Jun Liu, Tuo Zhang
Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels.
no code implementations • 22 Aug 2023 • Junyi Lu, Lei Yu, Xiaojia Li, Li Yang, Chun Zuo
In response to this research gap, we present LLaMA-Reviewer, an innovative framework that leverages the capabilities of LLaMA, a popular LLM, in the realm of code review.
no code implementations • 17 Aug 2023 • Li Yang, Abdallah Moubayed, Abdallah Shami, Amine Boukhtouta, Parisa Heidari, Stere Preda, Richard Brunner, Daniel Migault, Adel Larabi
In the prevailing convergence of traditional infrastructure-based deployment (i. e., Telco and industry operational networks) towards evolving deployments enabled by 5G and virtualization, there is a keen interest in elaborating effective security controls to protect these deployments in-depth.
no code implementations • 14 Jun 2023 • Zhusi Zhong, Jie Li, Lulu Bi, Li Yang, Ihab Kamel, Rama Chellappa, Xinbo Gao, Harrison Bai, Zhicheng Jiao
Medical image segmentation based on deep learning often fails when deployed on images from a different domain.
1 code implementation • 25 Apr 2023 • YongJae lee, Li Yang, Deliang Fan
Neural radiance field (NeRF) has shown remarkable performance in generating photo-realistic novel views.
no code implementations • 21 Apr 2023 • Tianyang Zhong, Yaonai Wei, Li Yang, Zihao Wu, Zhengliang Liu, Xiaozheng Wei, Wenjun Li, Junjie Yao, Chong Ma, Xiang Li, Dajiang Zhu, Xi Jiang, Junwei Han, Dinggang Shen, Tianming Liu, Tuo Zhang
The proposed method uses the strengths of LLMs' understanding and logical reasoning to correct the incomplete logical facts for optimizing the performance of perceptual module, by summarizing and reorganizing reasoning rules represented in natural language format.
no code implementations • 13 Mar 2023 • Jingtao Li, Adnan Siraj Rakin, Xing Chen, Li Yang, Zhezhi He, Deliang Fan, Chaitali Chakrabarti
We show that under practical cases, the proposed ME attacks work exceptionally well for SFL.
no code implementations • 13 Mar 2023 • Li Yang, Sen Lin, Fan Zhang, Junshan Zhang, Deliang Fan
Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially, giving rise to a new paradigm, namely self-supervised continual learning (SSCL).
no code implementations • 5 Feb 2023 • Daniel D Kim, Rajat S Chandra, Jian Peng, Jing Wu, Xue Feng, Michael Atalay, Chetan Bettegowda, Craig Jones, Haris Sair, Wei-Hua Liao, Chengzhang Zhu, Beiji Zou, Li Yang, Anahita Fathi Kazerooni, Ali Nabavizadeh, Harrison X Bai, Zhicheng Jiao
We investigated uncertainty sampling, annotation redundancy restriction, and initial dataset selection techniques.
no code implementations • 5 Jan 2023 • Meihua Zhou, Ivan Fung, Li Yang, Nan Wan, Keke Di, Tingting Wang
Due to the enormous population growth of cities in recent years, objects are frequently lost and unclaimed on public transportation, in restaurants, or any other public areas.
1 code implementation • NIPS 2022 • Li Yang, Jian Meng, Jae-sun Seo, Deliang Fan
In this work, for the first time, we propose a novel alternating sparse training (AST) scheme to train multiple sparse sub-nets for dynamic inference without extra training cost compared to the case of training a single sparse model from scratch.
no code implementations • 1 Nov 2022 • Sen Lin, Li Yang, Deliang Fan, Junshan Zhang
By learning a sequence of tasks continually, an agent in continual learning (CL) can improve the learning performance of both a new task and `old' tasks by leveraging the forward knowledge transfer and the backward knowledge transfer, respectively.
1 code implementation • 5 Oct 2022 • Li Yang, Abdallah Shami
In this paper, we propose a novel Multi-Stage Automated Network Analytics (MSANA) framework for concept drift adaptation in IIoT systems, consisting of dynamic data pre-processing, the proposed Drift-based Dynamic Feature Selection (DD-FS) method, dynamic model learning & selection, and the proposed Window-based Performance Weighted Probability Averaging Ensemble (W-PWPAE) model.
1 code implementation • 16 Sep 2022 • Li Yang, Abdallah Shami
Machine Learning (ML) approaches have shown their capacity for IoT data analytics.
1 code implementation • 5 Aug 2022 • Li Yang, Abdallah Shami, Gary Stevens, Stephen De Rusett
Modern vehicles, including autonomous vehicles and connected vehicles, have adopted an increasing variety of functionalities through connections and communications with other vehicles, smart devices, and infrastructures.
no code implementations • 21 May 2022 • Li Yang, Zhibin He, Changhe Li, Junwei Han, Dajiang Zhu, Tianming Liu, Tuo Zhang
The convolution on mesh considers the spatial organization of functional gradients and folding patterns on a cortical sheet and the newly designed channel attention block enhances the interpretability of the contribution of different functional gradients to cortical folding prediction.
1 code implementation • CVPR 2022 • Li Yang, Yan Xu, Chunfeng Yuan, Wei Liu, Bing Li, Weiming Hu
They base the visual grounding on the features from pre-generated proposals or anchors, and fuse these features with the text embeddings to locate the target mentioned by the text.
no code implementations • 29 Mar 2022 • Hong Qin, Syed Tareq, William Torres, Megan Doman, Cleo Falvey, Jamaree Moore, Meng Hsiu Tsai, Yingfeng Wang, Azad Hossain, Mengjun Xie, Li Yang
We examined the cointegration of the effective reproductive rate, Rt, of the virus with the dewpoint at two meters, the temperature at two meters, Apple driving mobility, and Google workplace mobility measurements.
no code implementations • 15 Feb 2022 • Megan Doman, Jacob Motley, Hong Qin, Mengjun Xie, Li Yang
COVID-19 related policies were extensively politicized during the 2020 election year of the United States, resulting in polarizing viewpoints.
1 code implementation • ICLR 2022 • Sen Lin, Li Yang, Deliang Fan, Junshan Zhang
To tackle this challenge, we propose Trust Region Gradient Projection (TRGP) for continual learning to facilitate the forward knowledge transfer based on an efficient characterization of task correlation.
1 code implementation • 27 Jan 2022 • Li Yang, Abdallah Shami
Modern vehicles, including autonomous vehicles and connected vehicles, are increasingly connected to the external world, which enables various functionalities and services.
no code implementations • 6 Jan 2022 • Qilong Huang, Li Yang, Chen Hou, Zhiyong Zeng, Yaowen Qi
Considering the mobility of EVs from building to building and their uncertain charging demand, it is of great practical interest to control the EV charging process in a microgrid of buildings to optimize the total operation cost while ensuring the transmission safety between the microgrid and the main grid.
no code implementations • CVPR 2022 • Li Yang, Adnan Siraj Rakin, Deliang Fan
To develop memory-efficient on-device transfer learning, in this work, we are the first to approach the concept of transfer learning from a new perspective of intermediate feature reprogramming of a pre-trained model (i. e., backbone).
no code implementations • CVPR 2022 • Jian Meng, Li Yang, Jinwoo Shin, Deliang Fan, Jae-sun Seo
Contrastive learning (or its variants) has recently become a promising direction in the self-supervised learning domain, achieving similar performance as supervised learning with minimum fine-tuning.
1 code implementation • 16 Dec 2021 • Li Yang, Qifan Wang, Zac Yu, Anand Kulkarni, Sumit Sanghai, Bin Shu, Jon Elsas, Bhargav Kanagal
Attribute value extraction refers to the task of identifying values of an attribute of interest from product information.
no code implementations • 10 Dec 2021 • Fengyun Zhang, Hao Li, Yulong Ding, Shuang-Hua Yang, Li Yang
The paper aims to reveal the relationship between the performance of moving object tracking algorithms and the tracking anchors (station) deployment.
no code implementations • 9 Dec 2021 • Fengyun Zhang, Li Yang, Yuhuan Liu, Yulong Ding, Shuang-Hua Yang, Hao Li
The challenges of indoor localization include inadequate localization accuracy, unreasonable anchor deployment in complex scenarios, lack of stability, and high cost.
1 code implementation • 18 Nov 2021 • Li Yang, Mai Xu, Shengxi Li, Yichen Guo, Zulin Wang
When assessing the quality of 360{\textdegree} video, human tends to perceive its quality degradation from the viewport-based spatial distortion of each spherical frame to motion artifact across adjacent frames, ending with the video-level quality score, i. e., a progressive quality assessment paradigm.
no code implementations • 3 Oct 2021 • Li Yang, Sen Lin, Junshan Zhang, Deliang Fan
To address this issue, continual learning has been developed to learn new tasks sequentially and perform knowledge transfer from the old tasks to the new ones without forgetting.
no code implementations • 29 Sep 2021 • Jun Fang, Li Yang, Chengyao Shen, Hamzah Abdel-Aziz, David Thorsley, Joseph Hassoun
In this work, we continue the effort to reduce the training cost of OFA methods.
no code implementations • 18 Sep 2021 • Yanwei Fu, Feng Li, Paula boned Fustel, Lei Zhao, Lijie Jia, Haojie Zheng, Qiang Sun, Shisong Rong, Haicheng Tang, xiangyang xue, Li Yang, Hong Li, Jiao Xie Wenxuan Wang, Yuan Li, Wei Wang, Yantao Pei, Jianmin Wang, Xiuqi Wu, Yanhua Zheng, Hongxia Tian, Mengwei Gu
The image-level performance of COVID-19 prescreening model in the China-Spain multicenter study achieved an AUC of 0. 913 (95% CI, 0. 898-0. 927), with a sensitivity of 0. 695 (95% CI, 0. 643-0. 748), a specificity of 0. 904 (95% CI, 0. 891 -0. 919), an accuracy of 0. 875(0. 861-0. 889), and a F1 of 0. 611(0. 568-0. 655).
no code implementations • 13 Sep 2021 • Dimitrios Michael Manias, Ibrahim Shaer, Li Yang, Abdallah Shami
As next-generation networks materialize, increasing levels of intelligence are required.
1 code implementation • 10 Sep 2021 • Li Yang, Dimitrios Michael Manias, Abdallah Shami
As the number of Internet of Things (IoT) devices and systems have surged, IoT data analytics techniques have been developed to detect malicious cyber-attacks and secure IoT systems; however, concept drift issues often occur in IoT data analytics, as IoT data is often dynamic data streams that change over time, causing model degradation and attack detection failure.
no code implementations • 24 Jul 2021 • Li Yang, Abdallah Moubayed, Abdallah Shami, Parisa Heidari, Amine Boukhtouta, Adel Larabi, Richard Brunner, Stere Preda, Daniel Migault
Content delivery networks (CDNs) provide efficient content distribution over the Internet.
no code implementations • CVPR 2021 • Xin Deng, Hao Wang, Mai Xu, Yichen Guo, Yuhang Song, Li Yang
In addition, we propose a deep reinforcement learning scheme with a latitude adaptive reward, in order to automatically select optimal upscaling factors for different latitude bands.
no code implementations • 12 Jun 2021 • Yanwei Fu, Lei Zhao, Haojie Zheng, Qiang Sun, Li Yang, Hong Li, Jiao Xie, xiangyang xue, Feng Li, Yuan Li, Wei Wang, Yantao Pei, Jianmin Wang, Xiuqi Wu, Yanhua Zheng, Hongxia Tian Mengwei Gu1
It is still nontrivial to develop a new fast COVID-19 screening method with the easier access and lower cost, due to the technical and cost limitations of the current testing methods in the medical resource-poor districts.
1 code implementation • 26 May 2021 • Li Yang, Abdallah Moubayed, Abdallah Shami
In this paper, the vulnerabilities of intra-vehicle and external networks are discussed, and a multi-tiered hybrid IDS that incorporates a signature-based IDS and an anomaly-based IDS is proposed to detect both known and unknown attacks on vehicular networks.
1 code implementation • 28 Apr 2021 • Li Yang, Yan Xu, Shaoru Wang, Chunfeng Yuan, Ziqi Zhang, Bing Li, Weiming Hu
However, the most suitable positions for inferring different targets, i. e., the object category and boundaries, are generally different.
1 code implementation • 21 Apr 2021 • Li Yang, Abdallah Shami
In recent years, with the increasing popularity of "Smart Technology", the number of Internet of Things (IoT) devices and systems have surged significantly.
no code implementations • 22 Mar 2021 • Li Yang
Remaining useful life (RUL) estimation is a crucial component in the implementation of intelligent predictive maintenance and health management.
no code implementations • 22 Mar 2021 • Adnan Siraj Rakin, Li Yang, Jingtao Li, Fan Yao, Chaitali Chakrabarti, Yu Cao, Jae-sun Seo, Deliang Fan
Apart from recovering the inference accuracy, our RA-BNN after growing also shows significantly higher resistance to BFA.
1 code implementation • 10 Mar 2021 • Li Yang, Mai Xu, Deng Xin, Bo Feng
To alleviate this issue, we propose a spatial attention-based perceptual quality prediction network for non-reference quality assessment on ODIs (SAP-net).
no code implementations • 11 Jan 2021 • Longjie Xie, Li Yang
In this paper, we study the diffusion approximation for singularly perturbed stochastic reaction-diffusion equation with a fast oscillating term.
Probability
no code implementations • 2 Dec 2020 • Li Yang, Adnan Siraj Rakin, Deliang Fan
We observe that large memory used for activation storage is the bottleneck that largely limits the training time and cost on edge devices.
no code implementations • 25 Nov 2020 • Sen Lin, Li Yang, Zhezhi He, Deliang Fan, Junshan Zhang
In this work, we advocate a holistic approach to jointly train the backbone network and the channel gating which enables dynamical selection of a subset of filters for more efficient local computation given the data input.
no code implementations • CVPR 2021 • Li Yang, Zhezhi He, Junshan Zhang, Deliang Fan
Thus motivated, we propose a new training method called \textit{kernel-wise Soft Mask} (KSM), which learns a kernel-wise hybrid binary and real-value soft mask for each task, while using the same backbone model.
no code implementations • 11 Sep 2020 • Li Yang, Zhezhi He, Yu Cao, Deliang Fan
Many techniques have been developed, such as model compression, to make Deep Neural Networks (DNNs) inference more efficiently.
2 code implementations • 30 Jul 2020 • Li Yang, Abdallah Shami
In this paper, optimizing the hyper-parameters of common machine learning models is studied.
11 code implementations • NeurIPS 2020 • Manzil Zaheer, Guru Guruganesh, Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontanon, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, Amr Ahmed
To remedy this, we propose, BigBird, a sparse attention mechanism that reduces this quadratic dependency to linear.
Ranked #1 on Text Classification on Arxiv HEP-TH citation graph
1 code implementation • ACL 2020 • Jianfei Yu, Jing Jiang, Li Yang, Rui Xia
To tackle the first issue, we propose a multimodal interaction module to obtain both image-aware word representations and word-aware visual representations.
Multi-modal Named Entity Recognition named-entity-recognition +1
2 code implementations • EMNLP 2020 • Joshua Ainslie, Santiago Ontanon, Chris Alberti, Vaclav Cvicek, Zachary Fisher, Philip Pham, Anirudh Ravula, Sumit Sanghai, Qifan Wang, Li Yang
Transformer models have advanced the state of the art in many Natural Language Processing (NLP) tasks.
Ranked #3 on Question Answering on ConditionalQA
1 code implementation • 18 Oct 2019 • Li Yang, Abdallah Moubayed, Ismail Hamieh, Abdallah Shami
The results from the implementation of the proposed intrusion detection system on standard data sets indicate that the system has the ability to identify various cyber-attacks in the AV networks.
1 code implementation • IEEE International Conference on Communications (ICC) 2019 • Ruipeng Zhang, Mengjun Xie, Li Yang
Our evaluation results show that a provider network with Isoflat can achieve similar network performance as a flat or VLAN provider network.
no code implementations • WS 2019 • Li Yang, Yang Xiang
Automatic dialect identification is a more challengingctask than language identification, as it requires the ability to discriminate between varieties of one language.
no code implementations • 30 May 2019 • Adnan Siraj Rakin, Zhezhi He, Li Yang, Yanzhi Wang, Liqiang Wang, Deliang Fan
In this work, we show that shrinking the model size through proper weight pruning can even be helpful to improve the DNN robustness under adversarial attack.
no code implementations • 27 May 2019 • Ye Tian, Li Yang, Wei Wang, Jing Zhang, Qing Tang, Mili Ji, Yang Yu, Yu Li, Hong Yang, Airong Qian
Traditionally, the most indispensable diagnosis of cervix squamous carcinoma is histopathological assessment which is achieved under microscope by pathologist.
1 code implementation • 26 May 2019 • Li Yang, Zhaoqi Leng, Guangyuan Yu, Ankit Patel, Wen-Jun Hu, Han Pu
Artificial neural networks have been successfully incorporated into variational Monte Carlo method (VMC) to study quantum many-body systems.
Strongly Correlated Electrons Disordered Systems and Neural Networks
no code implementations • 15 Apr 2019 • Mai Xu, Li Yang, Xiaoming Tao, Yiping Duan, Zulin Wang
According to these findings, our SalGAIL approach applies deep reinforcement learning (DRL) to predict the head fixations of one subject, in which GAIL learns the reward of DRL, rather than the traditional human-designed reward.
no code implementations • 27 Sep 2018 • Zhang Yanjun, Li Tie, Na Guangyu, Li Guoqing, Li Yang
The novelty of the proposal is in the fact that it improves the prediction performance of the ELM-based TSP model by using IPSO to optimize the parameters of the model with synchrophasors.