MilitarySpot.com

Serving the U.S. Army, Navy, Air Force, Marines, Coast Guard and National Guard

Camp Lejeune Claims
| VA Loans
Follow MilitarySpot:
 
  • Home
  • Enlist
    • Join The Army
    • Join The Navy
    • Join The Air Force
    • Join The Marines
    • Join The Coast Guard
    • Join The National Guard
    • ASVAB
    • Army Physical Fitness Test
    • Military Draft
    • Prior Service Army Enlistment
  • Career
    • Join the Military
    • Jobs for Military and Civilians
    • Career Center
    • Prior Service Army Enlistment
    • Criminal Justice
  • Education
    • Online Schools
    • Spouse Education Benefits
    • GI Bill
    • Military Schools
    • Criminal Justice
  • Benefits
    • Army Benefits
    • Navy Benefits
    • Air Force Benefits
    • Marine Corps Benefits
    • National Guard Benefits
    • Coast Guard Benefits
    • Veteran Benefits
    • Basic Pay Rates
    • Allowances
    • Special & Incentive Pay
    • Military Spouse Education Benefits
    • VA Education Benefits
    • GI Bill
  • News
    • Headline News
  • Finance
    • Debt Relief
    • Military Pay Rates
    • Military Personal Loans
    • VA Loans
    • Military Star Card
    • Military MyPay
  • Spouses
    • School Finder
    • Scholarships & Grants
    • PCS, DITY, & Moving
    • Pay Rates
    • MyCAA
    • Education Benefits
  • Community
    • Military Games
    • Military Reunions
    • Classifieds
    • Photo Gallery
    • Buddy Finder
    • MilitarySpot Pinups
    • Military Bases
  • Resources
    • Military Alphabet
    • Military Reunions
    • Military Acronyms
    • Currency Converter
    • Military Tools
    • Ranks
    • Military Time
    • Military Tactics
    • Military Discounts
    • Military Games
    • Military Videos
    • Photo Gallery
    • Infographics
    • How To
  • Travel

Army Researchers Develop Innovative Framework For Training AI

JUNE 10, 2021 — Army researchers developed a pioneering framework that provides a baseline for the development of collaborative multi-agent systems.

The framework is detailed in the survey paper “Survey of recent multi-agent reinforcement learning algorithms utilizing centralized training,” which is featured in the SPIE Digital Library. Researchers said the work will support research in reinforcement learning approaches for developing collaborative multi-agent systems such as teams of robots that could work side-by-side with future Soldiers.

“We propose that the underlying information sharing mechanism plays a critical role in centralized learning for multi-agent systems, but there is limited study of this phenomena within the research community,” said Army researcher and computer scientist Dr. Piyush K. Sharma of the U.S. Army Combat Capabilities Development Command, known as DEVCOM, Army Research Laboratory. “We conducted this survey of the state-of-the-art in reinforcement learning algorithms and their information sharing paradigms as a basis for asking fundamental questions on centralized learning for multi-agent systems that would improve their ability to work together.”

Sharma’s collaborators on this project include DEVCOM ARL researchers Drs. Erin Zaroukian, Rolando Fernandez, Michael Dorothy, Derrik Asher and Anjon Basak, a postdoctoral fellow under the Oak Ridge Associated Universities fellowship program.

This survey of state-of-the-art in reinforcement learning establishes a baseline for researchers seeking to develop autonomous multi-agent systems through enhanced information sharing mechanisms, for example rewarding functions or observation and state space sharing.

Training multiple agents simultaneously is more difficult due to the dynamic nature of complex environments that can suffer from the curse of dimensionality, the more agents there are, the more complicated the coordination becomes, Sharma said. This paper develops a framework to characterize the key information sharing parameters that are often confusing and not easy to understand.

The researchers predict that centralization in training may be the solution towards more rapidly developing autonomous systems that can flexibly work alongside Soldiers in the future.

“Consistent, centralized training can result in multi-agent systems that work more reliably together, increasing the level of trust from the Soldier of the artificial intelligence,” Sharma said. “Specifically, we focused on identifying and characterizing the underlying mathematical framework of the most recent centralized learning algorithms.”

Such a mathematical model can provide an avenue to explore alternate centralized learning techniques to gauge their effect on the learning rate and emergent collaborative behaviors, he said.

The survey exceeds prior research literature in two ways:

  • Creates a consolidated view of the latest state-of-the-art in reinforcement learning algorithms
  • Outlines a novel approach to describing information shared during centralized learning

The researchers focused on the algorithms published within five to six years. As these algorithms are very recent, they have not yet been explored extensively by the research community. At the time of publication, they did not find comprehensive prior work.

The researchers attempted to define and categorize the mechanisms for sharing, orienting on what is actually being shared as opposed to how it is shared. They are optimistic that they have identified gaps in the recent reinforcement learning techniques worthy of further study that could potentially enhance the agent training process.

The researchers said they are optimistic the survey will generate discussion and further exploration of the problem space of machine learning to train autonomous multi-agent systems.

“As the demand for multi-agent systems working cooperatively has become more prevalent in the commercial industry, for example, Amazon Warehouse Robots, Intel’s drone show at winter Olympics 2018. There is also an emerging need for these multi-agent system technologies to assist the Army in collaborative tactical operations,” Sharma said. “The research resulting from this survey document can make the goal of reliable, collaborative AI achievable.”

Moving forward, the team feels better equipped to investigate particular aspects of multi-agent reinforcement learning based approaches that train agents in centralized fashion.

Centralized techniques come with certain limitations, so they will also conduct empirical analysis of existing decentralized learning techniques, Sharma said. They plan to move towards modeling and simulation of multi-agent reinforcement learning training to validate and extend theories of agent learning, behavior and coordination.

As the Army’s corporate research laboratory, ARL is operationalizing science to achieve transformational overmatch. Through collaboration across the command’s core technical competencies, DEVCOM leads in the discovery, development and delivery of the technology-based capabilities required to make Soldiers more successful at winning the nation’s wars and come home safely. DEVCOM Army Research Laboratory is an element of the U.S. Army Combat Capabilities Development Command. DEVCOM is a major subordinate command of the Army Futures Command.

By U.S. Army DEVCOM Army Research Laboratory Public Affairs

Comments

Filed Under: Army, News

  • News
  • Enlist
  • Education
  • Career
  • Finance

Kentucky Guard Helps Community After Flooding

AUGUST 15, 2022 – As flood waters rose in Eastern Kentucky, the call went out to the National Guard that their help would be needed. In the hours following the first rainfall, hundreds of Kentucky Guard Soldiers were called on to provide rescue operations, supply distribution and security. For Army Staff Sgt. Matthew Dyal from […]

Army Develops Future Soldier Preparatory Course

JULY 27, 2022 – In response to the most challenging recruiting environment since the start of the all-volunteer force in 1973, the Army is implementing an innovative new program to prepare recruits who are en-route to initial military training to meet or exceed our rigorous standards. The Future Soldier Preparatory Course pilot program, which is […]

Top 5 University Scholarships for Military in the UK

JUNE 20, 2022 – The cost of a college education can be daunting and unaffordable for many university students in the UK. For the students who have set their hearts on joining the military, there are several scholarships available for them.  These scholarships help military students overcome the financial challenges of attending college. A University […]

Federal Hiring Summit for Transitioning Service Members

AUGUST 10, 2022 – Commander Navy Installation Command Headquarters, Fleet and Family Support Center is hosting a federal hiring summit Aug. 15-18. Although the summit is hosted by the Navy, all military personnel and their spouses can attend this virtual event. Those who are preparing for their end of service or actively transitioning out of […]

Military Consumer Month Focuses on Financial Literacy

JULY 29, 2022 – With inflation soaring in the U.S. and elsewhere, many among the military community, including reservists and veterans, are struggling to make financial ends meet and are in need of a good battle plan to beat their budget foes. Anyone in such a predicament would do well to employ the Department of […]

Recent Posts

  • Kentucky Guard Helps Community After Flooding
  • AF MQ-9s Close Out Successful RIMPAC Exercise
  • B-52 Lands In Maine After 29 Years
  • 4 Aspects of Civilian Life After Leaving the Military
  • Ukrainian Forces Make Some Gains in North, South
MAINMENU




SITESEARCH
Can't find something? Try using our site search to dig through our entire site.



Still having trouble? Try the Advanced Search to refine your searches.
NEWSLETTERSUBSCRIBE
Sign Up To Receive Information, Updates and Special Officers from MilitarySpot.com.



Don't miss an issue! Jump in the Newsletter Archives to catch up on previous issues.
FOLLOWMILITARY SPOT

Follow us on Facebook, Twitter & StumbleUpon and more. Keep up with MilitarySpot.com news & updates. We also have an RSS Feed.

Advertise | About | Contact | Feedback | Unsubscribe | DMCA | Privacy Policy | Terms of Use
 
Copyright 2004-2022 Sun Key Publishing. All Rights Reserved.



 
This is not the official recruiting website of the U.S. Military. The site you are on is run by Sun Key Publishing, a private company, and is not endorsed by or affiliated with the U.S. Military.