OpenIA and Figure present a humanoid robot that can communicate with people
Kyiv • UNN
OpenAI's generative AI model allows the humanoid robot Figure01 to communicate, perform tasks, and explain its actions when interacting with humans.
Equipped with OpenAI's generative AI model, Figure01 humanoid is able to answer questions while performing an action, describe the environment, and explain.
This was reported by UNN with reference to AI Robotics.
Details
The robotics company Figure AI has released a video about its latest prototype, which, thanks to OpenAI technology, can maintain a conversation while performing simple household tasks.
The 2.5-minute video shows a humanoid robot standing at a table. He calmly performs various tasks dictated to him by the engineer sitting in front of him. Their dialog is relatively smooth, as are the gestures he makes.
I'm hungry, give me something to eat
"Sure," the humanoid replies (in the voice of Steve Jobs). He takes an apple from the plate and hands it to him.
Later, another impressive action takes place - a person pours crumpled garbage from the trash can in front of Figure01 and asks the robot to explain why he did it, while picking up the garbage in the trash can. And the robot explains its "idea" by collecting the paper back into the trash can.
That's why I gave you an apple, because it's the only edible thing I can give you from the table
The humanoid is also able to evaluate its actions - when asked what it thinks it has done, it does not hesitate to give itself a good grade.
For reference
Representatives of the company explained that Figure01 uses OpenAI's pre-trained multimodal model, VLM, to understand images and text and relies on voice prompts to generate answers. In addition, the humanoid uses what the company calls "learned low-level bimanual manipulations." The system coordinates precise image calibration (down to the pixel level) with a neural network to control movement.
It is pointed out that every behavior in the video is based on the system's learning, so no one behind the scenes is directing Figure01's actions.
Recall
OpenAI denied Musk's claims that he had invested $1 billion in artificial intelligence development and said that he was seeking full control over the startup.
Trump supporters are using artificial intelligence to create fake images of the former president surrounded by smiling and grinning groups of black voters in an apparent attempt to attract African-American support for his potential 2024 presidential campaign.
