All Topics
All Topics
Technology
Technology
AI
AI
Business
Business
Entertainment
Entertainment
News
News
Programming
Programming
Science
Science
Design
Design
Environment
Environment
Finance
Finance
Crypto
Crypto
Politics
Politics
Sports
Sports
Education
Education
Gaming
Gaming
Art
Art
Music
Music
Health
Health
Security
Security
Books
Books
Food
Food
Travel
Travel
Personal
Personal
Bluesky
Twitter

Distributed Online Stochastic Convex-Concave Optimization: Dynamic Regret Analyses Under Single and Multiple Consensus Steps

1mo ago

Source

IEEEDistributed Online Stochastic Convex-Concave Optimization: Dynamic Regret Analyses Under Single and Multiple Consensus Stepsieee.org
Snippet from the RSS feed
This paper considers the distributed online convex-concave optimization with constraint sets over a multiagent network, in which each agent autonomously generates a series of decision pairs through a designable mechanism to cooperatively minimize the global loss function. To this end, under no-Euclidean distance metrics, we propose a distributed online stochastic mirror descent convex-concave optimization algorithm with time-varying predictive mappings. Taking dynamic saddle point regret as a performance metric, it is proved that the proposed algorithm achieves the regret upper-bound in $\boldsymbol{\mathcal{O}}\mathbf{(}\mathbf{max}\mathbf{\{}\boldsymbol{T^{\theta_{1}}},\boldsymbol{T^{\theta_{2}}}\mathbf{(1+}\boldsymbol{V_{T})}\mathbf{\})}$ for the general convex-concave loss function, where $\boldsymbol{\theta}_{\mathbf 1}\boldsymbol{,\theta}_{\mathbf 2}\boldsymbol{\in}\mathbf{(0,1)}$ are the tuning parameters, $\boldsymbol{T}$ is the total iteration time, and $\boldsymbol{V_{T}}$ is the path-variation. Surely, this algorithm guarantees the sublinear convergence, provided that $\boldsymbol{V_{T}}$ is sublinear. Moreover, aiming to achieve better convergence, we further investigate a variant of this algorithm by employing the multiple consensus technique. The obtained results show that the appropriate setting can effectively tighten the regret bound to a certain extent. Finally, the efficacy of the proposed algorithms is validated and compared through the simulation example of a target tracking problem.

You might also wanna read

Recurrent Structural Policy Gradient: A Method for Partially Observable Mean Field Games

This article introduces Recurrent Structural Policy Gradient (RSPG), a hybrid structural method for learning history-dependent policies in P

clarisse-wibault.github.io·5d ago

Unified Framework for Black-Box Optimization Reveals Hybrid Methods Outperform Constituent Algorithms

This paper presents a unified theoretical framework connecting several black-box optimization (BBO) methods — Evolution Strategies (ES), Con

arxiv.org·5d ago

Unified Framework for Black-Box Optimization Reveals Hybrid Methods Outperform Constituent Algorithms

This paper presents a unified theoretical framework connecting several black-box optimization (BBO) methods — Evolution Strategies (ES), Con

arxiv.org·5d ago

Reflecting on Optimisation: A Personal Take on Theory vs. Modern Practice

Magnus Ross reflects on his lack of deep study in optimisation, admitting he knows the basics (Adam, AdaGrad, L-BFGS) but zones out when dis

magnusross.github.io·11d ago

Contextual Rollout Bandits: A Neural Scheduling Framework for Efficient Reinforcement Learning with Verifiable Rewards

This paper introduces Contextual Rollout Bandits, a novel framework for Reinforcement Learning with Verifiable Rewards (RLVR) that addresses

arxiv.org·1mo ago

Adaptive LLM Routing Using Contextual Bandits and Shared Embedding Space

This research paper proposes a novel approach to LLM routing that treats it as a contextual bandit problem rather than supervised learning.

arxiv.org·10mo ago

Sheaf-ADMM: A Distributed Consensus Neural Network for Multi-Agent Coordination

This article introduces Sheaf-ADMM, a novel neural network architecture built on the intersection of sheaf theory and the Alternating Direct

pub.sakana.ai·4d ago

Comments

Sign in to join the conversation.

No comments yet. Be the first.