This paper proposes a synchronous parallel block coordinate descent algorithm for minimizing a composite function,which consists of a smooth convex function plus a non-smooth but separable convex function.Due to the g...This paper proposes a synchronous parallel block coordinate descent algorithm for minimizing a composite function,which consists of a smooth convex function plus a non-smooth but separable convex function.Due to the generalization of the proposed method,some existing synchronous parallel algorithms can be considered as special cases.To tackle high dimensional problems,the authors further develop a randomized variant,which randomly update some blocks of coordinates at each round of computation.Both proposed parallel algorithms are proven to have sub-linear convergence rate under rather mild assumptions.The numerical experiments on solving the large scale regularized logistic regression with 1 norm penalty show that the implementation is quite efficient.The authors conclude with explanation on the observed experimental results and discussion on the potential improvements.展开更多
The massive connectivity and limited energy pose significant challenges to deploy the enormous devices in energy-efficient and environmentally friendly in the Internet of Things(IoT).Motivated by these challenges,this...The massive connectivity and limited energy pose significant challenges to deploy the enormous devices in energy-efficient and environmentally friendly in the Internet of Things(IoT).Motivated by these challenges,this paper investigates the energy efficiency(EE)maximization problem for downlink cooperative non-orthogonal multiple access(C-NOMA)systems with hardware impairments(HIs).The base station(BS)communicates with several users via a half-duplex(HD)amplified-and-forward(AF)relay.First,we formulate the EE maximization problem of the system under HIs by jointly optimizing transmit power and power allocated coefficient(PAC)at BS,and transmit power at the relay.The original EE maximization problem is a non-convex problem,which is challenging to give the optimal solution directly.First,we use fractional programming to convert the EE maximization problem as a series of subtraction form subproblems.Then,variable substitution and block coordinate descent(BCD)method are used to handle the sub-problems.Next,a resource allocation algorithm is proposed to maximize the EE of the systems.Finally,simulation results show that the proposed algorithm outperforms the downlink cooperative orthogonal multiple access(C-OMA)scheme.展开更多
Reliable communication and intensive computing power cannot be provided effectively by temporary hot spots in disaster areas and complex terrain ground infrastructure.Mitigating this has greatly developed the applicat...Reliable communication and intensive computing power cannot be provided effectively by temporary hot spots in disaster areas and complex terrain ground infrastructure.Mitigating this has greatly developed the application and integration of UAV and Mobile Edge Computing(MEC)to the Internet of Things(loT).However,problems such as multi-user and huge data flow in large areas,which contradict the reality that a single UAV is constrained by limited computing power,still exist.Due to allowing UAV collaboration to accomplish complex tasks,cooperative task offloading between multiple UAVs must meet the interdependence of tasks and realize parallel processing,which reduces the computing power consumption and endurance pressure of terminals.Considering the computing requirements of the user terminal,delay constraint of a computing task,energy constraint,and safe distance of UAV,we constructed a UAV-Assisted cooperative offloading energy efficiency system for mobile edge computing to minimize user terminal energy consumption.However,the resulting optimization problem is originally nonconvex and thus,difficult to solve optimally.To tackle this problem,we developed an energy efficiency optimization algorithm using Block Coordinate Descent(BCD)that decomposes the problem into three convex subproblems.Furthermore,we jointly optimized the number of local computing tasks,number of computing offloaded tasks,trajectories of UAV,and offloading matching relationship between multi-UAVs and multiuser terminals.Simulation results show that the proposed approach is suitable for different channel conditions and significantly saves the user terminal energy consumption compared with other benchmark schemes.展开更多
To improve the efficiency and fairness of the spectrum allocation for ground communication assisted by unmanned aerial vehicles(UAVs),a joint optimization method for on-demand deployment and spectrum allocation of UAV...To improve the efficiency and fairness of the spectrum allocation for ground communication assisted by unmanned aerial vehicles(UAVs),a joint optimization method for on-demand deployment and spectrum allocation of UAVs is proposed,which is modeled as a mixed-integer non-convex optimization problem(MINCOP).An algorithm to estimate the minimum number of required UAVs is firstly proposed based on the pre-estimation and simulated annealing.The MINCOP is then decomposed into three sub-problems based on the block coordinate descent method,including the spectrum allocation of UAVs,the association between UAVs and ground users,and the deployment of UAVs.Specifically,the optimal spectrum allocation is derived based on the interference mitigation and channel reuse.The association between UAVs and ground users is optimized based on local iterated optimization.A particle-based optimization algorithm is proposed to resolve the subproblem of the UAVs deployment.Simulation results show that the proposed method could effectively improve the minimum transmission rate of UAVs as well as user fairness of spectrum allocation.展开更多
In this paper, a block coordinate descent method is developed to solve a linearly constrained separable convex optimization problem. The proposed method divides the decision variable into a few blocks based on certain...In this paper, a block coordinate descent method is developed to solve a linearly constrained separable convex optimization problem. The proposed method divides the decision variable into a few blocks based on certain rules. Then the candidate solution is iteratively obtained by updating one block at each iteration. The problem, whether or not there are overlapping regions between two immediately adjacent blocks, is investigated. The global convergence of the proposed method is established under some suitable assumptions. Numerical results show that the proposed method is effective compared with some ＂full-type＂ methods.展开更多
In this article,an efficient federated learning(FL)Framework in the Internet of Vehicles(IoV)is studied.In the considered model,vehicle users implement an FL algorithm by training their local FL models and sending the...In this article,an efficient federated learning(FL)Framework in the Internet of Vehicles(IoV)is studied.In the considered model,vehicle users implement an FL algorithm by training their local FL models and sending their models to a base station(BS)that generates a global FL model through the model aggregation.Since each user owns data samples with diverse sizes and different quality,it is necessary for the BS to select the proper participating users to acquire a better global model.Meanwhile,considering the high computational overhead of existing selection methods based on the gradient,the lightweight user selection scheme based on the loss decay is proposed.Due to the limited wireless bandwidth,the BS needs to select an suitable subset of users to implement the FL algorithm.Moreover,the vehicle users’computing resource that can be used for FL training is usually limited in the IoV when other multiple tasks are required to be executed.The local model training and model parameter transmission of FL will have significant effects on the latency of FL.To address this issue,the joint communication and computing optimization problem is formulated whose objective is to minimize the FL delay in the resource-constrained system.To solve the complex nonconvex problem,an algorithm based on the concave-convex procedure(CCCP)is proposed,which can achieve superior performance in the small-scale and delay-insensitive FL system.Due to the fact that the convergence rate of CCCP method is too slow in a large-scale FL system,this method is not suitable for delay-sensitive applications.To solve this issue,a block coordinate descent algorithm based on the one-step projected gradient method is proposed to decrease the complexity of the solution at the cost of light performance degrading.Simulations are conducted and numerical results show the good performance of the proposed methods.展开更多
The utilization of urban underground space in a smart city requires an accurate understanding of the underground structure.As an effective technique,Rayleigh wave exploration can accurately obtain information on the s...The utilization of urban underground space in a smart city requires an accurate understanding of the underground structure.As an effective technique,Rayleigh wave exploration can accurately obtain information on the subsurface.In particular,Rayleigh wave dispersion curves can be used to determine the near-surface shear-wave velocity structure.This is a typical multiparameter,high-dimensional nonlinear inverse problem because the velocities and thickness of each layer must be inverted simultaneously.Nonlinear methods such as simulated annealing(SA)are commonly used to solve this inverse problem.However,SA controls the iterative process though temperature rather than the error,and the search direction is random;hence,SA always falls into a local optimum when the temperature setting is inaccurate.Specifically,for the inversion of Rayleigh wave dispersion curves,the inversion accuracy will decrease with an increasing number of layers due to the greater number of inversion parameters and large dimension.To solve the above problems,we convert the multiparameter,highdimensional inverse problem into multiple low-dimensional optimizations to improve the algorithm accuracy by incorporating the principle of block coordinate descent(BCD)into SA.Then,we convert the temperature control conditions in the original SA method into error control conditions.At the same time,we introduce the differential evolution(DE)method to ensure that the iterative error steadily decreases by correcting the iterative error direction in each iteration.Finally,the inversion stability is improved,and the proposed inversion method,the block coordinate descent differential evolution simulated annealing(BCDESA)algorithm,is implemented.The performance of BCDESA is validated by using both synthetic data and field data from western China.The results show that the BCDESA algorithm has stronger global optimization capabilities than SA,and the inversion results have higher stability and accuracy.In addition,synthetic data analysis also shows that BCDESA can avoid the problems of the conventional SA method,which assumes the S-wave velocity structure in advance.The robustness and adaptability of the algorithm are improved,and more accurate shear-wave velocity and thickness information can be extracted from Rayleigh wave dispersion curves.展开更多
Internet of Things(IoT) can be conveniently deployed while empowering various applications, where the IoT nodes can form clusters to finish certain missions collectively. As energyefficient operations are critical to ...Internet of Things(IoT) can be conveniently deployed while empowering various applications, where the IoT nodes can form clusters to finish certain missions collectively. As energyefficient operations are critical to prolong the lifetime of the energy-constrained IoT devices, the Unmanned Aerial Vehicle(UAV) can be dispatched to geographically approach the IoT clusters towards energy-efficient IoT transmissions. This paper intends to maximize the system energy efficiency by considering both the IoT transmission energy and UAV propulsion energy, where the UAV trajectory and IoT communication resources are jointly optimized. By applying largesystem analysis and Dinkelbach method, the original fractional optimization is approximated and reformulated in the form of subtraction, and further a block coordinate descent framework is employed to update the UAV trajectory and IoT communication resources iteratively. Extensive simulation results are provided to corroborate the effectiveness of the proposed method.展开更多
Nonnegative tensor decomposition has become increasingly important for multiway data analysis in recent years. The alternating proximal gradient(APG) is a popular optimization method for nonnegative tensor decompositi...Nonnegative tensor decomposition has become increasingly important for multiway data analysis in recent years. The alternating proximal gradient(APG) is a popular optimization method for nonnegative tensor decomposition in the block coordinate descent framework. In this study, we propose an inexact version of the APG algorithm for nonnegative CANDECOMP/PARAFAC decomposition, wherein each factor matrix is updated by only finite inner iterations. We also propose a parameter warm-start method that can avoid the frequent parameter resetting of conventional APG methods and improve convergence performance.By experimental tests, we find that when the number of inner iterations is limited to around 10 to 20, the convergence speed is accelerated significantly without losing its low relative error. We evaluate our method on both synthetic and real-world tensors.The results demonstrate that the proposed inexact APG algorithm exhibits outstanding performance on both convergence speed and computational precision compared with existing popular algorithms.展开更多
In this paper,we investigate a parallel subspace correction framework for composite convex optimization.The variables are first divided into a few blocks based on certain rules.At each iteration,the algorithms solve a...In this paper,we investigate a parallel subspace correction framework for composite convex optimization.The variables are first divided into a few blocks based on certain rules.At each iteration,the algorithms solve a suitable subproblem on each block simultaneously,construct a search direction by combining their solutions on all blocks,then identify a new point along this direction using a step size satisfying the Armijo line search condition.They are called PSCLN and PSCLO,respectively,depending on whether there are overlapping regions between two imme-diately adjacent blocks of variables.Their convergence is established under mild assumptions.We compare PSCLN and PSCLO with the parallel version of the fast iterative thresholding algorithm and the fixed-point continuation method using the Barzilai-Borwein step size and the greedy coordinate block descent method for solving the l1-regularized minimization problems.Our numerical results showthatPSCLN andPSCLOcan run fast and return solutions notworse than those from the state-of-theart algorithms on most test problems.It is also observed that the overlapping domain decomposition scheme is helpful when the data of the problem has certain special structures.展开更多
Intelligent reflecting surface(IRS)is a promising technology for its capability of reflecting the incident signal towards the desired user.IRS can improve the efficiency of wireless communication systems.This paper in...Intelligent reflecting surface(IRS)is a promising technology for its capability of reflecting the incident signal towards the desired user.IRS can improve the efficiency of wireless communication systems.This paper introduces IRS into a device-to-device(D2D)communications system to improve the throughput of the D2D network.We adopt the block coordinate descent al-gorithm and semidefinite relaxation technique to optimize the beamforming vector,power allocation and phase shift matrix.Simulation results demonstrate that IRS is able to enhance the throughput of the D2D communications system,and the proposed algorithm significantly outper-forms the other benchmark algorithms.展开更多
Intelligent reflecting surface(IRS)is a revolutionizing and promising technology to improve the high transmission rate of the wireless communication systems.Specifically,an IRS consists of a great amount of low-cost p...Intelligent reflecting surface(IRS)is a revolutionizing and promising technology to improve the high transmission rate of the wireless communication systems.Specifically,an IRS consists of a great amount of low-cost passive reflecting elements,which reflect the incident signals to the desired user by collaboratively using passive beamforming.This paper introduces IRSs into a device-to-device(D2D)underlying cellular system to enhance transmission rate performance of the D2D pairs.We formulate an optimization problem of maximizing the transmission rate of the D2D pairs while satisfying the minimum required rate of the cellular users.We address this problem by jointly optimizing the reuse indicator,received beamforming,power allocation,and phase shift matrices.Block coordinate descent(BCD)algorithm is adopted to decouple the original problem into four subproblems.Closed form solutions are obtained by solving the sub-problems of optimizing the received beamforming and power allocation.Then,Kuhn-Munkres(KM)algorithm and minimization-majorization(MM)algorithm are adopted to solve the sub-problems of optimizing the reuse indicator and phase shift matrices,respectively.Simulation results demonstrate that IRSs can effectively improve the transmission rate of the D2D pairs and our proposed distributed IRSs scheme outperforms the other benchmark schemes.展开更多
The recommendation task with a textual corpus aims to model customer preferences from both user feedback and item textual descriptions.It is highly desirable to explore a very deep neural network to capture the compli...The recommendation task with a textual corpus aims to model customer preferences from both user feedback and item textual descriptions.It is highly desirable to explore a very deep neural network to capture the complicated nonlinear preferences.However,training a deeper recommender is not as effortless as simply adding layers.A deeper recommender suffers from the gradient vanishing/exploding issue and cannot be easily trained by gradient-based methods.Moreover,textual descriptions probably contain noisy word sequences.Directly extracting feature vectors from them can harm the recommender’s performance.To overcome these difficulties,we propose a new recommendation method named the HighwAy reco Mmender(HAM).HAM explores a highway mechanism to make gradient-based training methods stable.A multi-head attention mechanism is devised to automatically denoise textual information.Moreover,a block coordinate descent method is devised to train a deep neural recommender.Empirical studies show that the proposed method outperforms state-of-the-art methods significantly in terms of accuracy.展开更多
This paper addresses the planning problem of residential micro combined heat and power (micro-CHP) systems (including micro-generation units, auxiliary boilers, and thermal storage tanks) considering the associated te...This paper addresses the planning problem of residential micro combined heat and power (micro-CHP) systems (including micro-generation units, auxiliary boilers, and thermal storage tanks) considering the associated technical and economic factors. Since the accurate values of the thermal and electrical loads of this system cannot be exactly predicted for the planning horizon, the thermal and electrical load uncertainties are modeled using a two-stage adaptive robust optimization method based on a polyhedral uncertainty set. A solution method, which is composed of column-and-constraint generation (C&CG) algorithm and block coordinate descent (BCD) method, is proposed to efficiently solve this adaptive robust optimization model. Numerical results from a practical case study show the effective performance of the proposed adaptive robust model for residential micro-CHP planning and its solution method.展开更多
Convex clustering,turning clustering into a convex optimization problem,has drawn wide attention.It overcomes the shortcomings of traditional clustering methods such as K-means,Density-Based Spatial Clustring of Appli...Convex clustering,turning clustering into a convex optimization problem,has drawn wide attention.It overcomes the shortcomings of traditional clustering methods such as K-means,Density-Based Spatial Clustring of Applications with Noise(DBSCAN)and hierarchical clustering that can easily fall into the local optimal solution.However,convex clustering is vulnerable to the occurrence of outlier features,as it uses the Frobenius norm to measure the distance between data points and their corresponding cluster centers and evaluate clusters.To accurately identify outlier features,this paper decomposes data into a clustering structure component and a normalized component that captures outlier features.Different from existing convex clustering evaluating features with the exact measurement,the proposed model can overcome the vast difference in the magnitude of different features and the outlier features can be efficiently identified and removed.To solve the proposed model,we design an efficient algorithm and prove the global convergence of the algorithm.Experiments on both synthetic datasets and UCI datasets demonstrate that the proposed method outperforms the compared approaches in convex clustering.展开更多
Consider the problem of minimizing the sum of two convex functions,one being smooth and the other non-smooth.In this paper,we introduce a general class of approximate proximal splitting(APS)methods for solving such mi...Consider the problem of minimizing the sum of two convex functions,one being smooth and the other non-smooth.In this paper,we introduce a general class of approximate proximal splitting(APS)methods for solving such minimization problems.Methods in the APS class include many well-known algorithms such as the proximal splitting method,the block coordinate descent method(BCD),and the approximate gradient projection methods for smooth convex optimization.We establish the linear convergence of APS methods under a local error bound assumption.Since the latter is known to hold for compressive sensing and sparse group LASSO problems,our analysis implies the linear convergence of the BCD method for these problems without strong convexity assumption.展开更多
This work investigates the potential of the aerial intelligent reflecting surface(AIRS)in secure communication,where an intelligent reflecting surface(IRS)carried by an unmanned aerial vehicle(UAV)is utilized to help ...This work investigates the potential of the aerial intelligent reflecting surface(AIRS)in secure communication,where an intelligent reflecting surface(IRS)carried by an unmanned aerial vehicle(UAV)is utilized to help the communication between the ground nodes.Specifically,we formulate the joint design of the AIRS’s deployment and the phase shift to maximize the secrecy rate.To solve the non-convex objective,we develop an alternating optimization(AO)approach,where the phase shift optimization is solved by the Riemannian manifold optimization(RMO)method,while the deployment optimization is handled by the successive convex approximation(SCA)technique.Furthermore,to reduce the computational complexity of the RMO method,an element-wise block coordinate descent(EBCD)based method is employed.Simulation results verify the effect of AIRS in improving the communication security,as well as the importance of designing the deployment and phase shift properly.展开更多
Due to the high maneuverability of unmanned aerial vehicles(UAVs),they have been widely deployed to boost the performance of Internet of Things(IoT).In this paper,to promote the coverage performance of UAV-aided IoT c...Due to the high maneuverability of unmanned aerial vehicles(UAVs),they have been widely deployed to boost the performance of Internet of Things(IoT).In this paper,to promote the coverage performance of UAV-aided IoT communications,we maximize the minimum average rate of the IoT devices by jointly optimizing the resource allocation strategy and the UAV altitude.Particularly,to depict the practical propagation environment,we take the composite channel model including both the small-scale and the large-scale channel fading into account.Due to the difficulty in acquiring the random small-scale channel fading,we assume that only the large-scale channel sate information is available.On this basis,we formulate an optimization problem,which is not convex and challenging to solve.Then,an efficient iterative algorithm is proposed using block coordinate descent and successive convex optimization tools.Finally,simulation results are presented to demonstrate the significant performance gain of the proposed scheme over existing ones.展开更多
基金supported by the National Key R&D Program of China under Grant No.2018YFC0830300。
文摘This paper proposes a synchronous parallel block coordinate descent algorithm for minimizing a composite function,which consists of a smooth convex function plus a non-smooth but separable convex function.Due to the generalization of the proposed method,some existing synchronous parallel algorithms can be considered as special cases.To tackle high dimensional problems,the authors further develop a randomized variant,which randomly update some blocks of coordinates at each round of computation.Both proposed parallel algorithms are proven to have sub-linear convergence rate under rather mild assumptions.The numerical experiments on solving the large scale regularized logistic regression with 1 norm penalty show that the implementation is quite efficient.The authors conclude with explanation on the observed experimental results and discussion on the potential improvements.
基金partially supported by the National Natural Science Foundation of China under Grant 61701064Chongqing Natural Science Foundation under Grant cstc2019jcyj-msxmX0264Sichuan Science and Technology Program under Grant 2022YFQ0017。
文摘The massive connectivity and limited energy pose significant challenges to deploy the enormous devices in energy-efficient and environmentally friendly in the Internet of Things(IoT).Motivated by these challenges,this paper investigates the energy efficiency(EE)maximization problem for downlink cooperative non-orthogonal multiple access(C-NOMA)systems with hardware impairments(HIs).The base station(BS)communicates with several users via a half-duplex(HD)amplified-and-forward(AF)relay.First,we formulate the EE maximization problem of the system under HIs by jointly optimizing transmit power and power allocated coefficient(PAC)at BS,and transmit power at the relay.The original EE maximization problem is a non-convex problem,which is challenging to give the optimal solution directly.First,we use fractional programming to convert the EE maximization problem as a series of subtraction form subproblems.Then,variable substitution and block coordinate descent(BCD)method are used to handle the sub-problems.Next,a resource allocation algorithm is proposed to maximize the EE of the systems.Finally,simulation results show that the proposed algorithm outperforms the downlink cooperative orthogonal multiple access(C-OMA)scheme.
基金supported by the Jiangsu Provincial Key Research and Development Program(No.BE2020084-4)the National Natural Science Foundation of China(No.92067201)+2 种基金the National Natural Science Foundation of China(61871446)the Open Research Fund of Jiangsu Key Laboratory of Wireless Communications(710020017002)the Natural Science Foundation of Nanjing University of Posts and telecommunications(NY220047).
文摘Reliable communication and intensive computing power cannot be provided effectively by temporary hot spots in disaster areas and complex terrain ground infrastructure.Mitigating this has greatly developed the application and integration of UAV and Mobile Edge Computing(MEC)to the Internet of Things(loT).However,problems such as multi-user and huge data flow in large areas,which contradict the reality that a single UAV is constrained by limited computing power,still exist.Due to allowing UAV collaboration to accomplish complex tasks,cooperative task offloading between multiple UAVs must meet the interdependence of tasks and realize parallel processing,which reduces the computing power consumption and endurance pressure of terminals.Considering the computing requirements of the user terminal,delay constraint of a computing task,energy constraint,and safe distance of UAV,we constructed a UAV-Assisted cooperative offloading energy efficiency system for mobile edge computing to minimize user terminal energy consumption.However,the resulting optimization problem is originally nonconvex and thus,difficult to solve optimally.To tackle this problem,we developed an energy efficiency optimization algorithm using Block Coordinate Descent(BCD)that decomposes the problem into three convex subproblems.Furthermore,we jointly optimized the number of local computing tasks,number of computing offloaded tasks,trajectories of UAV,and offloading matching relationship between multi-UAVs and multiuser terminals.Simulation results show that the proposed approach is suitable for different channel conditions and significantly saves the user terminal energy consumption compared with other benchmark schemes.
基金supported by Project funded by China Postdoctoral Science Foundation(No.2021MD703980)。
文摘To improve the efficiency and fairness of the spectrum allocation for ground communication assisted by unmanned aerial vehicles(UAVs),a joint optimization method for on-demand deployment and spectrum allocation of UAVs is proposed,which is modeled as a mixed-integer non-convex optimization problem(MINCOP).An algorithm to estimate the minimum number of required UAVs is firstly proposed based on the pre-estimation and simulated annealing.The MINCOP is then decomposed into three sub-problems based on the block coordinate descent method,including the spectrum allocation of UAVs,the association between UAVs and ground users,and the deployment of UAVs.Specifically,the optimal spectrum allocation is derived based on the interference mitigation and channel reuse.The association between UAVs and ground users is optimized based on local iterated optimization.A particle-based optimization algorithm is proposed to resolve the subproblem of the UAVs deployment.Simulation results show that the proposed method could effectively improve the minimum transmission rate of UAVs as well as user fairness of spectrum allocation.
基金supported by the Natural Science Foundation of China(Grant No.11571074)the Natural Science Foundation of Fujian Province(Grant No.2015J01010)
文摘In this paper, a block coordinate descent method is developed to solve a linearly constrained separable convex optimization problem. The proposed method divides the decision variable into a few blocks based on certain rules. Then the candidate solution is iteratively obtained by updating one block at each iteration. The problem, whether or not there are overlapping regions between two immediately adjacent blocks, is investigated. The global convergence of the proposed method is established under some suitable assumptions. Numerical results show that the proposed method is effective compared with some ＂full-type＂ methods.
基金supported by the Fundamental Research Funds for the Central Universities(No.2022YJS127)the National Key Research and Development Program under Grant 2022YFB3303702the Key Program of National Natural Science Foundation of China under Grant 61931001。
文摘In this article,an efficient federated learning(FL)Framework in the Internet of Vehicles(IoV)is studied.In the considered model,vehicle users implement an FL algorithm by training their local FL models and sending their models to a base station(BS)that generates a global FL model through the model aggregation.Since each user owns data samples with diverse sizes and different quality,it is necessary for the BS to select the proper participating users to acquire a better global model.Meanwhile,considering the high computational overhead of existing selection methods based on the gradient,the lightweight user selection scheme based on the loss decay is proposed.Due to the limited wireless bandwidth,the BS needs to select an suitable subset of users to implement the FL algorithm.Moreover,the vehicle users’computing resource that can be used for FL training is usually limited in the IoV when other multiple tasks are required to be executed.The local model training and model parameter transmission of FL will have significant effects on the latency of FL.To address this issue,the joint communication and computing optimization problem is formulated whose objective is to minimize the FL delay in the resource-constrained system.To solve the complex nonconvex problem,an algorithm based on the concave-convex procedure(CCCP)is proposed,which can achieve superior performance in the small-scale and delay-insensitive FL system.Due to the fact that the convergence rate of CCCP method is too slow in a large-scale FL system,this method is not suitable for delay-sensitive applications.To solve this issue,a block coordinate descent algorithm based on the one-step projected gradient method is proposed to decrease the complexity of the solution at the cost of light performance degrading.Simulations are conducted and numerical results show the good performance of the proposed methods.
基金Supported by National Natural Science Foundation of China(NOs.41974150,42174158,42174151,41804126)a supporting program for outstanding talent of the University of Electronic Science and Technology of China(No.2019-QR-01)+1 种基金Project of Basic Scientific Research Operating Expenses of Central Universities(ZYGX2019J071ZYGX 2020J013).
文摘The utilization of urban underground space in a smart city requires an accurate understanding of the underground structure.As an effective technique,Rayleigh wave exploration can accurately obtain information on the subsurface.In particular,Rayleigh wave dispersion curves can be used to determine the near-surface shear-wave velocity structure.This is a typical multiparameter,high-dimensional nonlinear inverse problem because the velocities and thickness of each layer must be inverted simultaneously.Nonlinear methods such as simulated annealing(SA)are commonly used to solve this inverse problem.However,SA controls the iterative process though temperature rather than the error,and the search direction is random;hence,SA always falls into a local optimum when the temperature setting is inaccurate.Specifically,for the inversion of Rayleigh wave dispersion curves,the inversion accuracy will decrease with an increasing number of layers due to the greater number of inversion parameters and large dimension.To solve the above problems,we convert the multiparameter,highdimensional inverse problem into multiple low-dimensional optimizations to improve the algorithm accuracy by incorporating the principle of block coordinate descent(BCD)into SA.Then,we convert the temperature control conditions in the original SA method into error control conditions.At the same time,we introduce the differential evolution(DE)method to ensure that the iterative error steadily decreases by correcting the iterative error direction in each iteration.Finally,the inversion stability is improved,and the proposed inversion method,the block coordinate descent differential evolution simulated annealing(BCDESA)algorithm,is implemented.The performance of BCDESA is validated by using both synthetic data and field data from western China.The results show that the BCDESA algorithm has stronger global optimization capabilities than SA,and the inversion results have higher stability and accuracy.In addition,synthetic data analysis also shows that BCDESA can avoid the problems of the conventional SA method,which assumes the S-wave velocity structure in advance.The robustness and adaptability of the algorithm are improved,and more accurate shear-wave velocity and thickness information can be extracted from Rayleigh wave dispersion curves.
基金co-supported by the National Key Research and Development Program of China under Grant 2020YFB1807003National Natural Science Foundation of China(Nos.61901378,61941119)+1 种基金China Postdoctoral Science Foundation(Nos.BX20190287,2020M683563)Open Research Fund of National Mobile Communications Research Laboratory,Southeast University(No.2022D01)。
文摘Internet of Things(IoT) can be conveniently deployed while empowering various applications, where the IoT nodes can form clusters to finish certain missions collectively. As energyefficient operations are critical to prolong the lifetime of the energy-constrained IoT devices, the Unmanned Aerial Vehicle(UAV) can be dispatched to geographically approach the IoT clusters towards energy-efficient IoT transmissions. This paper intends to maximize the system energy efficiency by considering both the IoT transmission energy and UAV propulsion energy, where the UAV trajectory and IoT communication resources are jointly optimized. By applying largesystem analysis and Dinkelbach method, the original fractional optimization is approximated and reformulated in the form of subtraction, and further a block coordinate descent framework is employed to update the UAV trajectory and IoT communication resources iteratively. Extensive simulation results are provided to corroborate the effectiveness of the proposed method.
基金This work was supported by the National Natural Science Foundation of China(Grant No.91748105)the National Foundation in China(Grant Nos.JCKY2019110B009 and 2020-JCJQ-JJ-252)+1 种基金the Fundamental Research Funds for the Central Universities(Grant Nos.DUT20LAB303 and DUT20LAB308)in Dalian University of Technology in Chinathe scholarship from China Scholarship Council(Grant No.201600090043)。
文摘Nonnegative tensor decomposition has become increasingly important for multiway data analysis in recent years. The alternating proximal gradient(APG) is a popular optimization method for nonnegative tensor decomposition in the block coordinate descent framework. In this study, we propose an inexact version of the APG algorithm for nonnegative CANDECOMP/PARAFAC decomposition, wherein each factor matrix is updated by only finite inner iterations. We also propose a parameter warm-start method that can avoid the frequent parameter resetting of conventional APG methods and improve convergence performance.By experimental tests, we find that when the number of inner iterations is limited to around 10 to 20, the convergence speed is accelerated significantly without losing its low relative error. We evaluate our method on both synthetic and real-world tensors.The results demonstrate that the proposed inexact APG algorithm exhibits outstanding performance on both convergence speed and computational precision compared with existing popular algorithms.
基金Qian Dong was supported in part by the National Natural Science Foundation of China(Nos.11331012,11321061 and 11461161005)Xin Liu was supported in part by the National Natural Science Foundation of China(Nos.11101409,11331012,11471325 and 11461161005)+3 种基金China 863 Program(No.2013AA122902)the National Center for Mathematics and Interdisciplinary Sciences,Chinese Academy of SciencesZai-Wen Wen was supported in part by the National Natural Science Foundation of China(Nos.11322109 and 91330202)Ya-Xiang Yuan was supported in part by the National Natural Science Foundation of China(Nos.11331012,11321061 and 11461161005).
文摘In this paper,we investigate a parallel subspace correction framework for composite convex optimization.The variables are first divided into a few blocks based on certain rules.At each iteration,the algorithms solve a suitable subproblem on each block simultaneously,construct a search direction by combining their solutions on all blocks,then identify a new point along this direction using a step size satisfying the Armijo line search condition.They are called PSCLN and PSCLO,respectively,depending on whether there are overlapping regions between two imme-diately adjacent blocks of variables.Their convergence is established under mild assumptions.We compare PSCLN and PSCLO with the parallel version of the fast iterative thresholding algorithm and the fixed-point continuation method using the Barzilai-Borwein step size and the greedy coordinate block descent method for solving the l1-regularized minimization problems.Our numerical results showthatPSCLN andPSCLOcan run fast and return solutions notworse than those from the state-of-theart algorithms on most test problems.It is also observed that the overlapping domain decomposition scheme is helpful when the data of the problem has certain special structures.
基金This work was supported in part by Shenzhen Overseas High-Level Talents Innovation and Entrepreneurship under Grant KQJSCX20180328093835762in part by Shenzhen Basic Research Program under Grant JCYJ20190808122409660+1 种基金Grant JCYJ20170412104656685,in part by Key Project of DEGP(2018KCXTD027)The associate editor coordinating the review of this paper and approving it for publication was J.Xu.
文摘Intelligent reflecting surface(IRS)is a promising technology for its capability of reflecting the incident signal towards the desired user.IRS can improve the efficiency of wireless communication systems.This paper introduces IRS into a device-to-device(D2D)communications system to improve the throughput of the D2D network.We adopt the block coordinate descent al-gorithm and semidefinite relaxation technique to optimize the beamforming vector,power allocation and phase shift matrix.Simulation results demonstrate that IRS is able to enhance the throughput of the D2D communications system,and the proposed algorithm significantly outper-forms the other benchmark algorithms.
基金supported in part by the Shenzhen Basic Research Program under Grant 20200811192821001 and JCYJ20190808122409660in part by the Guangdong Basic Research Program under Grant 2019A1515110358,2021A1515012097,2020ZDZX1037,2020ZDZX1021+1 种基金in part by the open research fund of National Mobile Communications Research LaboratorySoutheast University under Grant 202ID 16,the key Project of DEGP under Grant 2018KCXTD027.
文摘Intelligent reflecting surface(IRS)is a revolutionizing and promising technology to improve the high transmission rate of the wireless communication systems.Specifically,an IRS consists of a great amount of low-cost passive reflecting elements,which reflect the incident signals to the desired user by collaboratively using passive beamforming.This paper introduces IRSs into a device-to-device(D2D)underlying cellular system to enhance transmission rate performance of the D2D pairs.We formulate an optimization problem of maximizing the transmission rate of the D2D pairs while satisfying the minimum required rate of the cellular users.We address this problem by jointly optimizing the reuse indicator,received beamforming,power allocation,and phase shift matrices.Block coordinate descent(BCD)algorithm is adopted to decouple the original problem into four subproblems.Closed form solutions are obtained by solving the sub-problems of optimizing the received beamforming and power allocation.Then,Kuhn-Munkres(KM)algorithm and minimization-majorization(MM)algorithm are adopted to solve the sub-problems of optimizing the reuse indicator and phase shift matrices,respectively.Simulation results demonstrate that IRSs can effectively improve the transmission rate of the D2D pairs and our proposed distributed IRSs scheme outperforms the other benchmark schemes.
基金the Key R&D Program of Zhejiang Province,China(No.2020C01024)the National Key R&D Program(No.2016YFB1001503)。
文摘The recommendation task with a textual corpus aims to model customer preferences from both user feedback and item textual descriptions.It is highly desirable to explore a very deep neural network to capture the complicated nonlinear preferences.However,training a deeper recommender is not as effortless as simply adding layers.A deeper recommender suffers from the gradient vanishing/exploding issue and cannot be easily trained by gradient-based methods.Moreover,textual descriptions probably contain noisy word sequences.Directly extracting feature vectors from them can harm the recommender’s performance.To overcome these difficulties,we propose a new recommendation method named the HighwAy reco Mmender(HAM).HAM explores a highway mechanism to make gradient-based training methods stable.A multi-head attention mechanism is devised to automatically denoise textual information.Moreover,a block coordinate descent method is devised to train a deep neural recommender.Empirical studies show that the proposed method outperforms state-of-the-art methods significantly in terms of accuracy.
文摘This paper addresses the planning problem of residential micro combined heat and power (micro-CHP) systems (including micro-generation units, auxiliary boilers, and thermal storage tanks) considering the associated technical and economic factors. Since the accurate values of the thermal and electrical loads of this system cannot be exactly predicted for the planning horizon, the thermal and electrical load uncertainties are modeled using a two-stage adaptive robust optimization method based on a polyhedral uncertainty set. A solution method, which is composed of column-and-constraint generation (C&CG) algorithm and block coordinate descent (BCD) method, is proposed to efficiently solve this adaptive robust optimization model. Numerical results from a practical case study show the effective performance of the proposed adaptive robust model for residential micro-CHP planning and its solution method.
基金This work was supported by the National Natural Science Foundation of China(No.11771003).
文摘Convex clustering,turning clustering into a convex optimization problem,has drawn wide attention.It overcomes the shortcomings of traditional clustering methods such as K-means,Density-Based Spatial Clustring of Applications with Noise(DBSCAN)and hierarchical clustering that can easily fall into the local optimal solution.However,convex clustering is vulnerable to the occurrence of outlier features,as it uses the Frobenius norm to measure the distance between data points and their corresponding cluster centers and evaluate clusters.To accurately identify outlier features,this paper decomposes data into a clustering structure component and a normalized component that captures outlier features.Different from existing convex clustering evaluating features with the exact measurement,the proposed model can overcome the vast difference in the magnitude of different features and the outlier features can be efficiently identified and removed.To solve the proposed model,we design an efficient algorithm and prove the global convergence of the algorithm.Experiments on both synthetic datasets and UCI datasets demonstrate that the proposed method outperforms the compared approaches in convex clustering.
文摘Consider the problem of minimizing the sum of two convex functions,one being smooth and the other non-smooth.In this paper,we introduce a general class of approximate proximal splitting(APS)methods for solving such minimization problems.Methods in the APS class include many well-known algorithms such as the proximal splitting method,the block coordinate descent method(BCD),and the approximate gradient projection methods for smooth convex optimization.We establish the linear convergence of APS methods under a local error bound assumption.Since the latter is known to hold for compressive sensing and sparse group LASSO problems,our analysis implies the linear convergence of the BCD method for these problems without strong convexity assumption.
基金supported in part by the National Natural Science Foundation of China(Nos.61901490,61801434,62071223,and 62031012)the Open Fund of the Shaanxi Key Laboratory of Information Communication Network and Security(No.ICNS201801)+1 种基金the Project funded by China Postdoctoral Science Foundation(No.2020M682345)the Henan Postdoctoral Foundation(No.202001015).
文摘This work investigates the potential of the aerial intelligent reflecting surface(AIRS)in secure communication,where an intelligent reflecting surface(IRS)carried by an unmanned aerial vehicle(UAV)is utilized to help the communication between the ground nodes.Specifically,we formulate the joint design of the AIRS’s deployment and the phase shift to maximize the secrecy rate.To solve the non-convex objective,we develop an alternating optimization(AO)approach,where the phase shift optimization is solved by the Riemannian manifold optimization(RMO)method,while the deployment optimization is handled by the successive convex approximation(SCA)technique.Furthermore,to reduce the computational complexity of the RMO method,an element-wise block coordinate descent(EBCD)based method is employed.Simulation results verify the effect of AIRS in improving the communication security,as well as the importance of designing the deployment and phase shift properly.
基金Beijing Natural science Foundation(No.L172041)the National Science Foundation of China(Nos.61701457,61771286,91638205,61671478 and 61621091).
文摘Due to the high maneuverability of unmanned aerial vehicles(UAVs),they have been widely deployed to boost the performance of Internet of Things(IoT).In this paper,to promote the coverage performance of UAV-aided IoT communications,we maximize the minimum average rate of the IoT devices by jointly optimizing the resource allocation strategy and the UAV altitude.Particularly,to depict the practical propagation environment,we take the composite channel model including both the small-scale and the large-scale channel fading into account.Due to the difficulty in acquiring the random small-scale channel fading,we assume that only the large-scale channel sate information is available.On this basis,we formulate an optimization problem,which is not convex and challenging to solve.Then,an efficient iterative algorithm is proposed using block coordinate descent and successive convex optimization tools.Finally,simulation results are presented to demonstrate the significant performance gain of the proposed scheme over existing ones.
