[X3D-Ecosystem] HAnim Live Networking Work In Progress Report

[John Carlson]

Read enclosure for context.

Also, the color of the joints can be changed currently, like a red, green
and blue (or any RGB color) skeleton.  Individual joint’s color is
addressable, but not in the current demo.

Perhaps eventually, I can hook up a humanoid robots to the network.  I’m
not certain I want to do that, but it might serve as a form of
accessibility.   That might involve transferring words across the network
instead of signing.  I don’t have words to/from mocap Babelfish yet.  It
does look like many people are working on that.  That could be a harder
problem than transferring translations and centers.   It might be easier to
transmit ISWA.

So I have several immediate goals:  Instead of just creating Transforms and
Shapes, create HAnimHumanoids, HAnimJoints and HAnimSegments to hold the
geometry.  Move the translations and centers into the HAnimJoints.  Move
the Transforms, Spheres and LineSets into the HAnimSegments.  Create an
HAnimJoint hierarchy (eventually).

I don’t currently have a skin in mind because I’m working on naming
currently.  I’ll need weights and everything, and I’m not sure how to
integrate weights currently, except when nodes (joints) are sent across the
network, perhaps with an insert verb.

I could use some help advocating the use of socket.io for X3D networks.  I
know that CGE is using mORMot 2, which AFAIK is Pascal-only.  I think it
mainly uses REST and web services.   It might be best to provide an SAI for
socket.io, which includes security.  if anyone is interested.  CyberTown
Revival (.wrl world) already has positions and rotations going over
socket.io, but I don’t know if those are the whole humanoid or not.   I
have colors, centers and translations of joints.  Centers may not be
necessary to transmit since they probably are in the 3D avatar from the
start.   My goal is to transmit novel HAnim currently.  I don’t have an
idea to transfer a HAnim URL, because I feel one will have to transfer a
URL for the humanoid, which will need to be validated.  CGE uses a URL.
Probably, I will start transmitting Humanoid models as URLs as well.

 I am somewhat limited because the mocap tool I use reports only joint
centers, so there’s no fixed length bones that I know of, because each body
may be different sizes.  If someone knows web-based mocap which captures
rotations, I’m interested.

So there’s a difference between live transforming a whole humanoid and
transforming individual “joints.” I am doing the later.  Is anyone else
doing that?  I am doing it because I am trying to transmit non-canned sign
language. X3D is an intermediate goal to controlling robotics for the
blind, perhaps an extended Tatum Robotics  arm, or a Tesla Suit.

John

On Tue, Apr 1, 2025 at 3:08 PM John Carlson <yottzumm at gmail.com> wrote:

> You can hooked up a webcam with my Python client and “watch” the skeleton
> do a live dance.  I have centers and translations being transmitted over
> the localhost network into a server, and distributed to clients.  Next step
> is to record PositionInterpolators, and I’ll have motion capture.  I
> already have multiple skeletons with nicknames I can control separately
> (not all at the same time).  I also need to do some authentication to
> secure the system for general use.  It might be possible to record basic
> hand signs in the future.
>
> I’ll probably be looking at web-based mocap soon.
>
> Ultimately, I plan to do HAnimJoints with HAnimSegment geometry and HAnim
> naming That’s in the code somewhere, I think.
>
> This is nearing a DIS-like solution for skeleton humanoids in X_ITE, and
> general time series 3D directed graphs.  The protocol header has frame
> number, timestamp (seconds, currently) and a nickname.
>
> If someone wants to know my prototype protocol, I can document it.  I’ll
> probably convert to JSON soon.  It’s currently CSV/SQL-like with all the
> problems of CSV, so it’s vulnerable to injection.
>
> John
>
> On Tue, Apr 1, 2025 at 2:21 PM <joedwil at earthlink.net> wrote:
>
>> Fine, what can that skeleton do in there?
>>
>>
>>
>> -----Original Message-----
>> From: Extensible 3D (X3D) Graphics public discussion <
>> x3d-public at web3d.org>
>> Sent: Mar 31, 2025 9:24 AM
>> To: X3D Graphics public mailing list <x3d-public at web3d.org>, Holger
>> Seelig <holger.seelig at yahoo.de>
>> Cc: John Carlson <yottzumm at gmail.com>
>> Subject: Re: [x3d-public] Adding LineSets in SAI, X_ITE
>>
>>
>> And woohoo, "complete" skeleton!
>>
>>
>>>
>>>>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://web3d.org/pipermail/x3d-ecosystem_web3d.org/attachments/20250401/89c5a9f9/attachment.html>