MilitarySpot.com

Serving the U.S. Army, Navy, Air Force, Marines, Coast Guard and National Guard

Follow MilitarySpot:
 
  • Home
  • Enlist
    • Join The Army
    • Join The Navy
    • Join The Air Force
    • Join The Marines
    • Join The Coast Guard
    • Join The National Guard
    • ASVAB
    • Army Physical Fitness Test
    • Military Draft
    • Prior Service Army Enlistment
  • Career
    • Join the Military
    • Jobs for Military and Civilians
    • Career Center
    • Prior Service Army Enlistment
    • Criminal Justice
  • Education
    • Online Schools
    • Spouse Education Benefits
    • GI Bill
    • Military Schools
    • Criminal Justice
  • Benefits
    • Army Benefits
    • Navy Benefits
    • Air Force Benefits
    • Marine Corps Benefits
    • National Guard Benefits
    • Coast Guard Benefits
    • Veteran Benefits
    • Basic Pay Rates
    • Allowances
    • Special & Incentive Pay
    • Military Spouse Education Benefits
    • VA Education Benefits
    • GI Bill
  • News
    • Headline News
  • Finance
    • Debt Relief
    • Military Pay Rates
    • Military Personal Loans
    • VA Loans
    • Military Star Card
    • Military MyPay
  • Spouses
    • School Finder
    • Scholarships & Grants
    • PCS, DITY, & Moving
    • Pay Rates
    • MyCAA
    • Education Benefits
  • Community
    • Military Games
    • Military Reunions
    • Classifieds
    • Photo Gallery
    • Buddy Finder
    • MilitarySpot Pinups
    • Military Bases
  • Resources
    • Military Alphabet
    • Military Reunions
    • Military Acronyms
    • Currency Converter
    • Military Tools
    • Ranks
    • Military Time
    • Military Tactics
    • Military Discounts
    • Military Games
    • Military Videos
    • Photo Gallery
    • Infographics
    • How To
  • Travel

Army Researchers Develop Innovative Framework For Training AI

JUNE 10, 2021 — Army researchers developed a pioneering framework that provides a baseline for the development of collaborative multi-agent systems.

The framework is detailed in the survey paper “Survey of recent multi-agent reinforcement learning algorithms utilizing centralized training,” which is featured in the SPIE Digital Library. Researchers said the work will support research in reinforcement learning approaches for developing collaborative multi-agent systems such as teams of robots that could work side-by-side with future Soldiers.

“We propose that the underlying information sharing mechanism plays a critical role in centralized learning for multi-agent systems, but there is limited study of this phenomena within the research community,” said Army researcher and computer scientist Dr. Piyush K. Sharma of the U.S. Army Combat Capabilities Development Command, known as DEVCOM, Army Research Laboratory. “We conducted this survey of the state-of-the-art in reinforcement learning algorithms and their information sharing paradigms as a basis for asking fundamental questions on centralized learning for multi-agent systems that would improve their ability to work together.”

Sharma’s collaborators on this project include DEVCOM ARL researchers Drs. Erin Zaroukian, Rolando Fernandez, Michael Dorothy, Derrik Asher and Anjon Basak, a postdoctoral fellow under the Oak Ridge Associated Universities fellowship program.

This survey of state-of-the-art in reinforcement learning establishes a baseline for researchers seeking to develop autonomous multi-agent systems through enhanced information sharing mechanisms, for example rewarding functions or observation and state space sharing.

Training multiple agents simultaneously is more difficult due to the dynamic nature of complex environments that can suffer from the curse of dimensionality, the more agents there are, the more complicated the coordination becomes, Sharma said. This paper develops a framework to characterize the key information sharing parameters that are often confusing and not easy to understand.

The researchers predict that centralization in training may be the solution towards more rapidly developing autonomous systems that can flexibly work alongside Soldiers in the future.

“Consistent, centralized training can result in multi-agent systems that work more reliably together, increasing the level of trust from the Soldier of the artificial intelligence,” Sharma said. “Specifically, we focused on identifying and characterizing the underlying mathematical framework of the most recent centralized learning algorithms.”

Such a mathematical model can provide an avenue to explore alternate centralized learning techniques to gauge their effect on the learning rate and emergent collaborative behaviors, he said.

The survey exceeds prior research literature in two ways:

  • Creates a consolidated view of the latest state-of-the-art in reinforcement learning algorithms
  • Outlines a novel approach to describing information shared during centralized learning

The researchers focused on the algorithms published within five to six years. As these algorithms are very recent, they have not yet been explored extensively by the research community. At the time of publication, they did not find comprehensive prior work.

The researchers attempted to define and categorize the mechanisms for sharing, orienting on what is actually being shared as opposed to how it is shared. They are optimistic that they have identified gaps in the recent reinforcement learning techniques worthy of further study that could potentially enhance the agent training process.

The researchers said they are optimistic the survey will generate discussion and further exploration of the problem space of machine learning to train autonomous multi-agent systems.

“As the demand for multi-agent systems working cooperatively has become more prevalent in the commercial industry, for example, Amazon Warehouse Robots, Intel’s drone show at winter Olympics 2018. There is also an emerging need for these multi-agent system technologies to assist the Army in collaborative tactical operations,” Sharma said. “The research resulting from this survey document can make the goal of reliable, collaborative AI achievable.”

Moving forward, the team feels better equipped to investigate particular aspects of multi-agent reinforcement learning based approaches that train agents in centralized fashion.

Centralized techniques come with certain limitations, so they will also conduct empirical analysis of existing decentralized learning techniques, Sharma said. They plan to move towards modeling and simulation of multi-agent reinforcement learning training to validate and extend theories of agent learning, behavior and coordination.

As the Army’s corporate research laboratory, ARL is operationalizing science to achieve transformational overmatch. Through collaboration across the command’s core technical competencies, DEVCOM leads in the discovery, development and delivery of the technology-based capabilities required to make Soldiers more successful at winning the nation’s wars and come home safely. DEVCOM Army Research Laboratory is an element of the U.S. Army Combat Capabilities Development Command. DEVCOM is a major subordinate command of the Army Futures Command.

By U.S. Army DEVCOM Army Research Laboratory Public Affairs

Comments

Filed Under: Army, News

  • News
  • Enlist
  • Education
  • Career
  • Finance

U.S. Forces Seize Illegal Drugs in Gulf of Oman

FEBRUARY 2, 2023 – A U.S. Coast Guard vessel seized illegal drugs worth a total estimated U.S. street value of $33 million from a fishing vessel transiting international waters in the Gulf of Oman, Jan. 30. U.S. Coast Guard cutter USCGC Emlen Tunnell (WPC 1145) was patrolling regional waters in support of Combined Task Force […]

Pre-Enlistment Course Helps in Recruiting

DECEMBER 21, 2022 – Amid one of the most challenging recruiting environments since the all-volunteer force’s establishment in 1973, the National Guard has taken a modern approach to engaging prospective service members. Only 23% of Americans ages 17-24 qualify to serve without a medical waiver, down from 29% in recent years. While obesity, addiction, medical, […]

Top 10 Reasons to Earn an AS in Aviation Maintenance

FEBRUARY 2, 2023 — The U.S. Naval Community College will start taking applications for the Associate of Science in Aviation Maintenance Feb. 27, 2023. This degree will be offered in partnership with Embry-Riddle Aeronautical University and will include a Naval Studies Certificate embedded in the program. Here are the top ten reasons you should apply […]

Top 10 Reasons to Earn an AS in Aviation Maintenance

FEBRUARY 2, 2023 — The U.S. Naval Community College will start taking applications for the Associate of Science in Aviation Maintenance Feb. 27, 2023. This degree will be offered in partnership with Embry-Riddle Aeronautical University and will include a Naval Studies Certificate embedded in the program. Here are the top ten reasons you should apply […]

2023 CONUS COLA Rates Released

DECEMBER 27, 2022 – The Defense Department released the 2023 Continental United States Cost-of-Living Allowance (CONUS COLA) rates, which take effect Jan. 1, 2023. In 2023, $8 million will be paid to approximately 5,000 service members stationed within CONUS. CONUS COLA is a supplemental allowance designed to help offset higher prices in the highest-cost locations […]

Recent Posts

  • U.S. Forces Seize Illegal Drugs in Gulf of Oman
  • MUSTANGS: The Future of Agile Data Capture
  • Air National Guard Modernizes F-16 Capabilities
  • U.S. Supports Partner Forces in Major Iranian Weapons Seizure
  • Aircraft Simulator Keeps Aircrew Ready
MAINMENU




SITESEARCH
Can't find something? Try using our site search to dig through our entire site.



Still having trouble? Try the Advanced Search to refine your searches.
NEWSLETTERSUBSCRIBE
Sign Up To Receive Information, Updates and Special Officers from MilitarySpot.com.



Don't miss an issue! Jump in the Newsletter Archives to catch up on previous issues.
FOLLOWMILITARY SPOT

Follow us on Facebook, Twitter & StumbleUpon and more. Keep up with MilitarySpot.com news & updates. We also have an RSS Feed.

Advertise | About | Contact | Feedback | Unsubscribe | DMCA | Privacy Policy | Terms of Use
 
Copyright 2004-2023 Sun Key Publishing. All Rights Reserved.



 
This is not the official recruiting website of the U.S. Military. The site you are on is run by Sun Key Publishing, a private company, and is not endorsed by or affiliated with the U.S. Military.