New Mars Forums

Official discussion forum of The Mars Society and MarsNews.com

You are not logged in.

Announcement

Announcement: As a reader of NewMars forum, we have opportunities for you to assist with technical discussions in several initiatives underway. NewMars needs volunteers with appropriate education, skills, talent, motivation and generosity of spirit as a highly valued member. Write to newmarsmember * gmail.com to tell us about your ability's to help contribute to NewMars and become a registered member.

#76 2024-01-22 08:13:53

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

Free trials of DALL-E are available ...

I learned today (from our contact in Alaska) that DALL-E is available for free trial.

The free trial offer has a limit ... it may be 15 images a week.

(th)

Offline

#77 2024-01-22 08:28:13

NewMarsMember
Member
Registered: 2019-02-17
Posts: 1,253

Re: Teleoperation

Apache Internal Server Error refused to permit posting of information about how to create an image and display it here.

I've logged back in as NewMarsMember to see if it has better luck.

To begin with, there is a convenient icon to download the image. Let's see if AISE will permit display of that information:

The icon shows up in the upper left corner of the image if you move the mouse over the image.

OK ... so far, so good....

You have a choice of file types and png is one of them ....

You can download a PNG version of the file to your hard drive (eg, download folder)

So far, so good ...

You can then upload the PNG file to imgur.com

Use left click to obtain the BBCode for the link to the image

Post the link in NewMars...

I'd be very interested in seeing what happens if you use the prompt published earlier in this topic.

(th)


Recruiting High Value members for NewMars.com/forums, in association with the Mars Society

Offline

#78 2024-01-22 09:53:26

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

Today's work session with ChatGPT4 and DALL-E aimed to see if we could create an image of a vacuum cleaner for Teleoperation.

We only needed two tries this time...

DALL-E Prompt for Teleoperated Vacuum Cleaner Image
An image of a remote-controlled vacuum cleaner, self-driven and battery-powered. The vacuum cleaner should have at least three wheels and a visible dust collector. A small smartphone, proportional in size to the vacuum cleaner, is installed in a holder on the vacuum, securely held and positioned vertically to view the floor in front of the vacuum. The smartphone's placement and size are crucial for the remote operator to effectively see and navigate the cleaning area. The scene should highlight the practicality and innovative aspect of this teleoperated cleaning solution.

Link to file: https://drive.google.com/file/d/14Uc4F_ … sp=sharing

Link to image:Ys83JmK.png

(th)

Offline

#79 2024-01-22 14:31:00

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

In this work session, ChatGPT4 and I considered additional ways we might think about Teleoperation for home services...

Here is a list that combines ideas ....

Telepresence and Teleoperation in Elder Care

Telepresence Applications

  • Remote Social Interaction: Facilitates video calls and virtual visits to maintain social connections.

  • Telehealth Consultations: Enables remote medical consultations and check-ins.

  • Virtual Assistance: Provides companionship through AI-enabled virtual assistants or avatars.

Teleoperation Applications

  • Meal Preparation Assistance: Remotely controlled kitchen tools to assist in meal preparation.

  • Medication Management: Teleoperated systems for organizing and dispensing medication.

  • Physical Assistance: Devices to assist with mobility, operated remotely by caregivers.

  • Emergency Response: Systems for immediate assistance or check-ins in emergencies.

Integrating Retired Individuals as Service Providers

  • Training and Engagement: Training retired individuals to operate telepresence and teleoperation systems.

  • Skill Utilization: Matching retirees' skills with appropriate teleoperated tasks.

  • Community Building: Connecting retirees with elderly people needing assistance to foster support networks.

The report above was prepared by ChatGPT4 with supervision by tahansons43206, who is responsible for correcting any errors that may occur.

(th)

Offline

#80 2024-01-22 19:56:54

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

An attempt to persuade DALL-E to create an image of a Teleoperated garden tractor was not successful.  Perhaps it is worth revisiting later.

The Elon Musk Optimus robot would be an ideal avatar for remote elder care, if it were fitted with communications capability. 

(th)

Offline

#81 2024-01-23 08:30:54

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

Today's work session was more successful!  We decided to investigate Tonka Toy ....

The prompt below was refined after several tries:

DALL-E Prompt for Teleoperated Tonka Truck Image
An image of a bright yellow Tonka truck equipped with electric motors and a smartphone mounted in a holder. The smartphone should be vertical and pointing in front of the truck, emphasizing its role in remote operation and control.

The market for working toys is large and growing. Adding the Smartphone controller would greatly increase the capabilities of the toy.

Link to image file: https://drive.google.com/file/d/1-BCa0h … sp=sharing

Link to image: iRYAyxG.png

Work shown was prepared by DALL-E via ChatGPT4 supervised by tahanson43206.

(th)

Offline

#82 2024-01-23 13:20:45

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

I cast another search on the Internet, looking for vendors in the Teleoperation space ... I found one that seems to be close to offering a remote meeting avatar robot, so I put a question into their Contact page:

I am looking for a device that can attend Zoom meetings for me. It would be nice to have the ability to move around a meeting room. The host has a laptop which could run interface software. Is your system able to provide remote teleoperation this way? (th)

(th)

Offline

#83 2024-02-05 14:15:12

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

This post is about Apple's vision headset, which I understand they refuse to call a Virtual Reality headset.

https://www.youtube.com/watch?v=dtp6b76pMak

I'm interested in this technology for teloperation.

You carry the battery in your pocket.

(th)

Offline

#84 2024-02-08 12:23:59

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

Here is an update from a company actively doing teleoperation:

Deploying Remote Operation Technology
With Phantom Auto

Feb. 8, 2024

Having deployed Phantom Auto's remotely operated forklifts with a number of top-tier logistics companies, we understand from experience how a well-developed deployment plan is critical for success.

In collaboration with our customers, we've developed an implementation plan for efficiently deploying our state-of-the-art remotely operated vehicles. We align on customer goals and objectives, conduct site evaluation and testing, and collaborate on vehicle configuration before transitioning into live production.

Phantom's dedicated team of world-class deployment experts—including customer success managers and engineers—will be with you through the process, ensuring we can quickly add value to your operation and establishing the foundation for long-term success.


For a deeper dive into deploying remote operation technology with Phantom Auto, check out this on-demand webinar with Phantom's Head of Remote Operations, Sam Hyman, and VP of Sales, Ryan Clifford.

The video is called Are We There Yet? ... https://phantom.auto/videos

The video is mostly interviews, but it does show some scenes of workers operating remove vehicles, as well as remote vehicles on site.

I am interested in this technology because it shows what is possible today, and (I expect) will become quite common in the future.  There is no reason for folks to move to a job site, and for the employer to provide all the accommodations that folks need. 

(th)

Offline

#85 2024-03-07 14:02:56

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

Here is an update about a company doing teleoperation.

The aspect of this report that caught my eye is that the company has won FAA approval to fly out of sight.

That is a key requirement for the Teleoperation industry to unfold on the scale that I foresee.

https://censystech.com/sentaero-5-luanch/

The article is about purchase of this system by a traffic control agency in a midwestern state in the US...

Ohio will test $40,000 drone to monitor its highways with special FAA permission
Story by Mark Feuerborn • 9h

COLUMBUS, Ohio (WCMH) — An Ohio agency has added a nearly $40,000 drone and special permission from the Federal Aviation Administration to its arsenal, and will begin testing the aircraft in monitoring the state’s highways.

The Ohio Department of Transportation acquired a Censys Sentaero 5 drone for $39,689, spokeswoman Breanna Badanes confirmed to NBC4. The agency has chosen a four-mile stretch of U.S. 33 between U.S. 42 and Watkins Road as the testing grounds for its drone pilots. There, paired with spotters on the ground, they’ll practice using the Sentaero for incident management and traffic monitoring.


ODOT already has an extensive, publicly-available network of ground cameras on the state’s highways. But there are still areas where they’re missing, and Badanes said the Sentaero can benefit emergency responders with sensors for radiation and chemical toxins, which the ground cameras don’t have.

“Expanding operations across the state will allow us to cover gaps in our fixed camera system and gain valuable information about the movement of traffic across our transportation system,” Badanes said.

The Ohio Department of Transportation’s Censys Sentaero 5. (Courtesy Photo/Ohio Department of Transportation)
© Provided by WCMH Columbus

The Ohio Department of Transportation’s Censys Sentaero 5. (Courtesy Photo/Ohio Department of Transportation)

© Provided by WCMH Columbus

An Ohio Department of Transportation crew member inspects the agency’s Censys Sentaero drone. (Courtesy Photo/Ohio Department of Transportation)
© Provided by WCMH Columbus

Rich Fox, ODOT’s Unmanned Aircraft System Center Director, said the drone offers another way for the agency to quickly get real-time data beyond what the stationary ground cameras offer, such as finding crashes, congestion or hazards on the roads.

“Depending on the aircraft, they can be equipped with object detection and analytics, which form a critical piece in improving safety on the roadway,” Fox said. “This is just the beginning.”

ODOT’s plan for the drone falls outside the norm for the majority of commercial and recreational drone pilots. The FAA requires most pilots to only fly their drones in a way that lets them constantly keep a visual line-of-sight on the unmanned aircraft systems. In order to fly a drone where a pilot can’t directly see it, they have to apply to receive a waiver from the FAA that grants special permission to do so.

Badanes confirmed on Feb. 28 that ODOT’s pilots obtained a beyond visual line-of-sight waiver from the FAA. Censys, the company behind the Sentaero 5, advertises it as specifically intended for flights beyond visual line-of-sight. It touted on its website that the drone can stay up in the air for an hour, and can fly up to 40 miles away from its pilot.

Badanes did not respond to a question on if ODOT would be purchasing more drones, or just planned to operate with the single Sentaero. She did say that no test date for the drone had been set as of Thursday, since the crew is still training on how to use it.

Copyright 2022 Nexstar Media, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.
For the latest news, weather, sports, and streaming video, head to NBC4 WCMH-TV.

(th)

Offline

#86 2024-03-10 12:25:43

SpaceNut
Administrator
From: New Hampshire
Registered: 2004-07-22
Posts: 28,910

Offline

#87 2024-03-11 06:04:40

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

For SpaceNut re #86

Thanks for finding and showing the link to this report!

Researchers have developed a system for real-time human-to-humanoid teleoperation that allows full-body control, heralding a future of seamless collaboration between humans and machines.

The Carnegie Mellon University team’s teleoperation system is based on reinforcement learning (RL) and features scalable retargeting and training facilitated by vast human motion datasets.

Using nothing more than an RGB camera, individuals can now seamlessly teleoperate with full-sized humanoids to execute a myriad of actions. According to researchers, from simple tasks like picking and placing to dynamic movements like walking, kicking, and even boxing, this technology empowers users to engage in immersive and intuitive interactions like never before.

Expand article logo  Continue reading
The details of the team’s research were published in the journal ArXiv.

Challenges in developing full-body control

I am not surprised to see Carnegie Mellon's name in this report. CMU has been a leader in robot development for decades. It is likely that "Red" Whittaker is retired by now. He was the driving force decades ago. Google came up with many citations about William (Red) L. Whittaker.

(th)

Offline

#88 2024-03-11 08:30:16

Void
Member
Registered: 2011-12-29
Posts: 7,121

Re: Teleoperation

This could open the Moon up to remote manipulations.

Done


Done.

Offline

#89 2024-03-11 11:01:10

Calliban
Member
From: Northern England, UK
Registered: 2019-08-18
Posts: 3,434

Re: Teleoperation

Interesting topic.  Humans could teleoperate humanoid robots from Mars orbit and build a base.  They would never actually have to land.  A large ship could take them to Mars orbit and back again using low thrust ion propulsion.  This might be an early option for exploring Mars and building a base for humans to inhabit before anyone lands.  It allows humans to teleoperate robots in real time without transmission lag.

Last edited by Calliban (2024-03-11 11:02:20)


"Plan and prepare for every possibility, and you will never act. It is nobler to have courage as we stumble into half the things we fear than to analyse every possible obstacle and begin nothing. Great things are achieved by embracing great dangers."

Offline

#90 2024-04-06 06:33:13

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

The snippet below is from a recent post by Mars_B4_Moon ...

also remote operation
https://www.youtube.com/watch?v=zBPlGz1T5gs
Last edited by Mars_B4_Moon (Today 03:30:48)

I haven't followed the link yet, but the text implies it may be associated with Teleoperation, and therefore a possible addition to this topic.

(th)

Offline

#91 2024-04-06 06:37:17

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,219

Re: Teleoperation

I am interested in the field of Teleoperation because it opens potential employment for older workers, in the millions and potentially billions.

As humans age, they tend to lose the edge they have when younger, but their experience and education remain available and valuable long after the physical body is given a well earned rest from the 40 hour+ work week.

I am seeing a potential for work sessions for older workers that would be on the order of two to three hours long, that would insure that great experience and wisdom are watching and supervising/guiding the actions of smart robots around the world, and potentially in orbit, on the Moon, and elsewhere.

The potential for income from these activities is non-trivial. 

(th)

Offline

Board footer

Powered by FluxBB