Canadarm3 collision avoidance AI solutions sought as operational needs solidify

With launch just five years away, the Gateway Exploration Robotics System — better known as… The post Canadarm3 collision avoidance AI solutions sought as operational needs solidify appeared first on NASASpaceFlight.com.

Canadarm3 collision avoidance AI solutions sought as operational needs solidify

With launch just five years away, the Gateway Exploration Robotics System — better known as Canadarm3 — has arrived at a critical point where its artificial intelligence system must be properly calibrated to meet the rigorous autonomous demands the Lunar Gateway project will impose upon it.

The AI solutions sought for Canadarm3’s vision by MDA and the Canadian Space Agency (CSA) largely relate to obstacle avoidance to prevent the arm from bumping into other structures on the lunar outpost and how to work with issues like prolonged communications blackouts and less-than-optimal lighting conditions — both of which must be overcome for the Gateway.

Speaking at a recent industry day event, Chris Langley, AI Lead at MDA for Canadarm3, related some of the challenges posed to the project by the Gateway operations plan, including only one month per year of crewed occupation initially and as little as only 8 hours of communication each week.

Additionally, the Gateway will also, as of now, seek to demonstrate an autonomy goal of 21 days without human intervention — during which Canadarm3 would have to operate and perform tasks.

“The idea is to really push for a Mars forward type philosophy.  So we would have as little as one, eight hour communication window per week.  And during the rest of that, the robotics is on its own; the station is on its own.  And it all has to keep functioning,” said Langley.

“This leads to a lot of interesting areas where AI can be applied,” noted Langley.  “First, because we’re operating during loss of signal, we need to have that autonomous execution capability and the ability to recover from any faults that happen as we’re doing our execution.  We also need to have systems to close the loop on board.”

“One of those… so as the Gateway flexes and changes with the thermal and pressure environments, where the robotic interfaces [that Canadarm3 will grab onto and use to move around the complex] are will move slightly, so we need to close all those loops and we need it to be able to self-diagnose and work to fix issues [without human input].”

However, an equally critical element for Canadarm3’s ability to autonomously perform operations while out of communication with Earth relates to its ability to sense — or see — its environment and avoid obstacles that may be present, such as mounting brackets, experiment platforms, visiting vehicle components, handrails for astronaut EVAs (extravehicular activities, or spacewalks), etc.

To try and define these potential issues and set up platforms for obstacle avoidance AI solutions testing, MDA used their Training AI Laboratory (TRAIL) and a 6 degree of freedom robot based on Dextre to capture data on a series of maneuvers (under both nominal and off-nominal conditions) that Canadarm3 will likely be called upon to perform.

“What we’re trying to do is tease out different problems that may arise or technology gaps that may arise with Canadarm3 and how we can address them and if the right fit is AI.  And we’re not limited to just using a robot and cameras.  We’re looking at this across-the-board in terms of other elements such as the ground segment and planning of robotic motions as well.”

“Basically all the different sectors for Canadarm3, we’re looking to see if there are ways — if AI is the best solution — that we can progress the technology.” 

For this specific obstacle avoidance test series, TRAIL utilized multiple cameras to capture video of the Dextre-derived robot in motion while either no obstacle (nominal) or an obstacle (off-nominal) was placed near or along its optimal path.

The robot came into contact with an obstacle (defined by MDA  as either a direct collision or a “marked as collision” event because it came too close to the obstacle) 112 times across 330 test runs.

Alberta Machine Intelligence Institute

“As we’ve been going to the program, we’ve come to realize that we have lots of data on these things, but all the data is not perhaps in a format that’s readily available to AI researchers,” said Dickinson.  “So we’ve been working with our partners at Amii to make the data as AI-enabled as possible so that researchers can then immediately take it, deploy it, and start working on different algorithms for how we can approach this problem.”

The Gateway and Canadarm3’s vision systems will have to contend with any and all possible lighting conditions, as unlike the ISS’s robotic systems that can simply wait for more favorable lighting and shadow conditions, the Gateway’s arm will not have that luxury — nor will it have the ability to wait for a human to tell it that the “obstacle” in front of it is just a shadow.

“The Gateway will see some lighting changes that will play a role in how some of the systems are developed,” said Dickinson.  “We have tried to include in the TRAIL data set a variety of lighting conditions to mimic that somewhat.”

Langley added: “On Gateway, everything is quasi-static.  So if you find yourself in a good lighting condition on the day of your operation, that’s great.  If not, you’re stuck.  You still have to do that [operation] no matter what conditions you see at the time.”

Moreover, it’s not just a simple matter of just “turning on a light” at the end of the End Effector — or hand — of Canadarm3 to “see better.”

“We are planning to have illuminators on the End Effectors so we can turn on another source of light,” noted Langley.  “But it’s a real challenge.  It’s a power draw and heat dissipation issue.  Every time you have the lights on, you generate a lot of waste heat that has to be dissipated from the arm somehow.  So we need to be sort of parsimonious with how we add lights.”

While five years is a somewhat compressed timeline to arrive at a solution, it is well within MDA’s and CSA’s experience bases — and well suited to the Canadian AI and robotics industry.

Furthermore, some elements of the design that are will in flux, like the exact location of cameras outside Gateway that will be critical for autonomous arm operations, location for grapple fixture points, clearance between modules/external equipment, will become known as the architecture of the Gateway solidifies — something that will aid Canadarm3’s AI design.

The first elements of the Gateway, the combined Power & Propulsion Element (PPE) and Habitation and Logistics (HALO) modules are set to launch no earlier than May 2024 on a Falcon Heavy rocket from LC-39A at the Kennedy Space Center.

Canadarm3 is currently set to launch in the third quarter of 2026 during the Phase 2 expansion of the Gateway to include the International Partner elements; however, numerous components of its robotic interfaces will be mounted to and launched with the PPE and HALO “and potentially other aspects of the HLS in Phase 1,” noted CSA during the industry day presentation.

The Canadian Space Agency awarded MDA the contract to design, build, and deliver those interfaces earlier this month.

The overall Gateway Exploration Robotics System is part of Canada’s larger commitment to NASA’s Artemis program and lunar exploration overall.  On 26 May, CSA announced Canada’s first robotic rover to the Moon, in cooperation with NASA, that is planned to launch by 2026.

(Lead image: Artist’s impression of Canadarm3. Credit: CSA)

The post Canadarm3 collision avoidance AI solutions sought as operational needs solidify appeared first on NASASpaceFlight.com.

Source : NASA More   

What's Your Reaction?

like
0
dislike
0
love
0
funny
0
angry
0
sad
0
wow
0

Next Article

June 10 Solar Eclipse in the Northern Hemisphere! On June 10, people in parts of the northern...

June 10 Solar Eclipse in the Northern Hemisphere! On June 10, people in parts of the northern hemisphere will have the chance to witness a solar eclipse.Watch the full visualization of the eclipse.The June 10 eclipse is an annular solar eclipse, meaning that the Sun will never be completely covered by the Moon. The Moon’s orbit around the Earth is not a perfect circle, so throughout each month, the Moon’s distance from Earth varies. During an annular eclipse, the Moon is far enough away from Earth that the Moon appears smaller than the Sun in the sky. Since the Moon does not block the entire view of the Sun, it will look like a dark disk on top of a larger, bright disk. This creates what looks like a ring of fire around the Moon.People in the narrow path of annularity — which, for this eclipse, cuts through Canada, Greenland, and northern Russia — will see the ring of fire effect as the Moon passes across the Sun.Credit: Dale CruikshankOutside this path of annularity, many people in the northern hemisphere have a chance to see a partial solar eclipse. The partial eclipse will fall on parts of the eastern United States, as well as northern Alaska. Some locations will only see a very small piece of the Sun covered, while locations closer to the path of annularity can see the Moon cover most of the Sun.To learn which times the eclipse may be visible in certain areas, you can click anywhere on the map here. (Note that the maximum obscuration and maximum eclipse timing noted on this map may occur before sunrise in many locations.)This solar eclipse is a pair with the total lunar eclipse that happened on May 26.Both solar and lunar eclipses happen when the Sun, Moon, and Earth line up in the same plane — a lunar eclipse happens when Earth is in the middle and casts its shadow on the Moon, and a solar eclipse happens when the Moon is in the middle and casts its shadow on Earth. The Moon’s orbit is tilted, so it’s usually too high or too low for this alignment to work out.The May 26 lunar eclipse was a supermoon lunar eclipse, meaning that the full moon happened while the Moon was near its closest point to Earth, making the Moon appear larger in the sky. The solar eclipse happens at the opposite point of the Moon’s orbit, during the new moon — and in this case, the new moon happens near the Moon’s farthest point from Earth, making the Moon appear smaller and resulting in an annular (rather than total) solar eclipse.How to watch the eclipseFrom anywhere: Watch the eclipse online with us! Weather permitting, we’ll be sharing live telescope views of the partial eclipse courtesy of Luc Boulard of the Royal Astronomical Society of Canada Sudbury Centre. Tune in starting at 5 a.m. EDT on June 10 at nasa.gov/live. From the path of the annular or partial eclipse: Be sure to take safety precuations if you plan to watch in person!It is never safe to look directly at the Sun’s rays, even if the Sun is partly or mostly obscured, like during a partial or annular eclipse — doing so can severely harm your eyes. If you’re planning to watch the eclipse on June 10, you should use solar viewing glasses or an indirect viewing method at all points during the eclipse if you want to face the Sun. Solar viewing glasses, sometimes called eclipse glasses, are NOT regular sunglasses; regular sunglasses are not safe for viewing the Sun.If you don’t have solar viewing or eclipse glasses, you can use an alternate indirect method like a pinhole projector. Pinhole projectors shouldn’t be used to look at the Sun; instead, they’re an easy way to project an image of the Sun onto a surface. Read more about how to create a pinhole projector. This is a sunrise eclipse in the contiguous U.S. At locations in the lower 48 states that can see the partial eclipse, the show starts before sunrise, when the Sun is still below the horizon. That means the best chance to see the eclipse in these locations will be during and shortly after sunrise, when the Sun is very low in the sky. In northern Alaska, the eclipse happens in the very early hours of June 10 when the Sun is low on the horizon. Bottom line: If you’re trying to watch the eclipse in the contiguous U.S., look for a location with a clear view of the horizon to the northeast, and plan to watch starting at sunrise with your solar filter or indirect viewer.The next two eclipses in the continental U.S. are in 2023 and 2024. The annular solar eclipse of Oct. 14, 2023, will cut from Oregon to Texas, and the total solar eclipse of April 8, 2024, will pass from Texas to Maine. Keep up with the latest on eclipses and eclipse science at nasa.gov/eclipse. Make sure to follow us on Tumblr for your regular dose of space: http://nasa.tumblr.com.

June 10 Solar Eclipse in the Northern Hemisphere! On June 10, people in parts of the northern...

June 10 Solar Eclipse in the Northern Hemisphere!

On June 10, people in parts of the northern hemisphere will have the chance to witness a solar eclipse.

Watch the full visualization of the eclipse.

The June 10 eclipse is an annular solar eclipse, meaning that the Sun will never be completely covered by the Moon. The Moon’s orbit around the Earth is not a perfect circle, so throughout each month, the Moon’s distance from Earth varies. During an annular eclipse, the Moon is far enough away from Earth that the Moon appears smaller than the Sun in the sky. Since the Moon does not block the entire view of the Sun, it will look like a dark disk on top of a larger, bright disk. This creates what looks like a ring of fire around the Moon.

People in the narrow path of annularity — which, for this eclipse, cuts through Canada, Greenland, and northern Russia — will see the ring of fire effect as the Moon passes across the Sun.

Credit: Dale Cruikshank

Outside this path of annularity, many people in the northern hemisphere have a chance to see a partial solar eclipse. The partial eclipse will fall on parts of the eastern United States, as well as northern Alaska. Some locations will only see a very small piece of the Sun covered, while locations closer to the path of annularity can see the Moon cover most of the Sun.

To learn which times the eclipse may be visible in certain areas, you can click anywhere on the map here. (Note that the maximum obscuration and maximum eclipse timing noted on this map may occur before sunrise in many locations.)

This solar eclipse is a pair with the total lunar eclipse that happened on May 26.

Both solar and lunar eclipses happen when the Sun, Moon, and Earth line up in the same plane — a lunar eclipse happens when Earth is in the middle and casts its shadow on the Moon, and a solar eclipse happens when the Moon is in the middle and casts its shadow on Earth. The Moon’s orbit is tilted, so it’s usually too high or too low for this alignment to work out.

The May 26 lunar eclipse was a supermoon lunar eclipse, meaning that the full moon happened while the Moon was near its closest point to Earth, making the Moon appear larger in the sky. The solar eclipse happens at the opposite point of the Moon’s orbit, during the new moon — and in this case, the new moon happens near the Moon’s farthest point from Earth, making the Moon appear smaller and resulting in an annular (rather than total) solar eclipse.

How to watch the eclipse

From anywhere: Watch the eclipse online with us! Weather permitting, we’ll be sharing live telescope views of the partial eclipse courtesy of Luc Boulard of the Royal Astronomical Society of Canada Sudbury Centre. Tune in starting at 5 a.m. EDT on June 10 at nasa.gov/live.

From the path of the annular or partial eclipse: Be sure to take safety precuations if you plan to watch in person!

It is never safe to look directly at the Sun’s rays, even if the Sun is partly or mostly obscured, like during a partial or annular eclipse — doing so can severely harm your eyes. If you’re planning to watch the eclipse on June 10, you should use solar viewing glasses or an indirect viewing method at all points during the eclipse if you want to face the Sun. Solar viewing glasses, sometimes called eclipse glasses, are NOT regular sunglasses; regular sunglasses are not safe for viewing the Sun.

If you don’t have solar viewing or eclipse glasses, you can use an alternate indirect method like a pinhole projector. Pinhole projectors shouldn’t be used to look at the Sun; instead, they’re an easy way to project an image of the Sun onto a surface. Read more about how to create a pinhole projector.

This is a sunrise eclipse in the contiguous U.S. At locations in the lower 48 states that can see the partial eclipse, the show starts before sunrise, when the Sun is still below the horizon. That means the best chance to see the eclipse in these locations will be during and shortly after sunrise, when the Sun is very low in the sky. In northern Alaska, the eclipse happens in the very early hours of June 10 when the Sun is low on the horizon.

Bottom line: If you’re trying to watch the eclipse in the contiguous U.S., look for a location with a clear view of the horizon to the northeast, and plan to watch starting at sunrise with your solar filter or indirect viewer.

The next two eclipses in the continental U.S. are in 2023 and 2024. The annular solar eclipse of Oct. 14, 2023, will cut from Oregon to Texas, and the total solar eclipse of April 8, 2024, will pass from Texas to Maine. Keep up with the latest on eclipses and eclipse science at nasa.gov/eclipse.

Make sure to follow us on Tumblr for your regular dose of space: http://nasa.tumblr.com.

Source : NASA More   

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies.