[x3d-public] Labels in 3D

Leonard Daly Leonard.Daly at realism.com
Wed Sep 13 21:02:57 PDT 2017


Andreas,

Is it like drawing a line from the near to far clipping planes where 
each point on the line projects to the current cursor position, then 
taking the closest HTML element that intersects the line?

I suppose you could do the inverse of that operation by projecting each 
HTML element (or container) onto the near clipping plan and picking the 
one that is the closest to the near clipping plane and is "under" the 
cursor.

In VR with two hand controllers, you could use a line intersection for 
picking. That would be much easier.

Leonard Daly




> Leonard,
>
> just as an additional pointer, there have been attempts in aframe to 
> have an interactive HTML view in 3d. I believe they were based on 
> backprojecting mouse events from the 3d plane to the page. There is 
> perhaps an aframe component which does this.
>
> Andreas
>
>
>
>     From: Leonard Daly <Leonard.Daly at realism.com
>     <mailto:Leonard.Daly at realism.com>>
>     To: x3d-public at web3d.org <mailto:x3d-public at web3d.org>
>     Subject: Re: [x3d-public] Labels in 3D
>     Message-ID: <1fd785ed-e3bb-9076-0914-ded1578d89b1 at realism.com
>     <mailto:1fd785ed-e3bb-9076-0914-ded1578d89b1 at realism.com>>
>     Content-Type: text/plain; charset="utf-8"; Format="flowed"
>
>     Andreas,
>
>     I had considered some of your features. I was working with the
>     requirement that the label needed to have full HTML support so it
>     could
>     be modified, have control features (buttons, links, etc.) and perhaps
>     have other media embedded in it. I suppose it might have been possible
>     to put all of those features into a billboard-presented 3D-space
>     label;
>     but there was too much capability that would have needed to be
>     recreated.
>
>     I will keep the links as I have encountered needed to work from
>     HTML to
>     3D texture in the past.
>
>     Leonard Daly
>
>
>     > If the labels should live in the 3d space of the scene as bill
>     boards,
>     > another approach would be to render the html to a texture using
>     these
>     > approaches:
>     >
>     >
>     https://developer.mozilla.org/en-US/docs/Web/API/Canvas_API/Drawing_DOM_objects_into_a_canvas
>     <https://developer.mozilla.org/en-US/docs/Web/API/Canvas_API/Drawing_DOM_objects_into_a_canvas>
>     > https://html2canvas.hertzen.com/documentation.html
>     <https://html2canvas.hertzen.com/documentation.html>
>     >
>     > x3dom can then use the canvas element directly as a texture for a
>     > rectangle plane bill boarded next to the object to be labelled.
>     >
>     > The leader line in this case is simply a 3d line or tube from the
>     > object to the label rectangle.
>     >
>     > Ideas, Andreas
>     >
>     >     Date: Tue, 5 Sep 2017 11:51:11 -0700
>     >     From: Leonard Daly <Leonard.Daly at realism.com
>     <mailto:Leonard.Daly at realism.com>
>     >     <mailto:Leonard.Daly at realism.com
>     <mailto:Leonard.Daly at realism.com>>>
>     >     To: X3D Public <x3d-public at web3d.org
>     <mailto:x3d-public at web3d.org> <mailto:x3d-public at web3d.org
>     <mailto:x3d-public at web3d.org>>>
>     >     Subject: [x3d-public] Labels in 3D
>     >     Message-ID:
>     <9965f0da-0842-772f-a3b1-131af3f167b0 at realism.com
>     <mailto:9965f0da-0842-772f-a3b1-131af3f167b0 at realism.com>
>     >     <mailto:9965f0da-0842-772f-a3b1-131af3f167b0 at realism.com
>     <mailto:9965f0da-0842-772f-a3b1-131af3f167b0 at realism.com>>>
>     >     Content-Type: text/plain; charset="utf-8"; Format="flowed"
>     >
>     >     This is mostly for Nicholas and Vince who expressed an
>     interest in
>     >     labeling things in 3D where the labels had the capability of
>     HTML to
>     >     include various fonts, styles, text, graphics, links, etc.
>     >
>     >     I would like to know if these types of labels meet your needs or
>     >     something else is needed.
>     >
>     >     This is using my testbed (XSeen). The example is at
>     > http://realism.com/XSEEN/test/labels.html
>     <http://realism.com/XSEEN/test/labels.html>
>     >     <http://realism.com/XSEEN/test/labels.html
>     <http://realism.com/XSEEN/test/labels.html>>.
>     >
>     >     All labels are done in HTML. The lines connecting the label
>     to the 3D
>     >     object is done in 3D space. The labels retain their screen
>     position as
>     >     the camera is moved. There are three types of labels illustrated
>     >     in the
>     >     example -- fixed, relative, and draggable.
>     >
>     >     The fixed label is attached to the "monster" The label line
>     tracks the
>     >     local origin of the monster model.
>     >
>     >     The relative label maintains the initial relative screen
>     position
>     >     to the
>     >     projection of the (local) origin of the object. The label
>     moves as the
>     >     object moves. This is particularly obvious when looking from
>     the side.
>     >
>     >     The last label (draggable) is attached to the torus. The
>     user may move
>     >     the label to any position in the canvas (2D projection of the 3D
>     >     space).
>     >     The leader line maintains the connection from the label to
>     the object.
>     >
>     >     There is preliminary documentation on the tag at
>     >
>     http://tools.realism.com/specification/xseen/language-definition/user-interactions/label
>     <http://tools.realism.com/specification/xseen/language-definition/user-interactions/label>
>     >   
>      <http://tools.realism.com/specification/xseen/language-definition/user-interactions/label
>     <http://tools.realism.com/specification/xseen/language-definition/user-interactions/label>>
>     >
>     >     Caveats:
>     >     1) The leader lines do not track well when the camera
>     position is
>     >     changing nor when a draggable label is being moved.
>     >     2) Things don't work as you would expect (or hope) for the
>     stereo
>     >     camera.
>     >
>     >
>     >     --
>     >     *Leonard Daly*
>     >     3D Systems & Cloud Consultant
>     >     LA ACM SIGGRAPH Chair
>     >     President, Daly Realism - /Creating the Future/
>     >     -------------- next part --------------
>     >     An HTML attachment was scrubbed...
>     >     URL:
>     >   
>      <http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20170905/01d20b36/attachment.html
>     <http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20170905/01d20b36/attachment.html>
>     >   
>      <http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20170905/01d20b36/attachment.html
>     <http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20170905/01d20b36/attachment.html>>>
>     >
>     >     ------------------------------
>     >
>     >     Subject: Digest Footer
>     >
>     >     _______________________________________________
>     >     x3d-public mailing list
>     > x3d-public at web3d.org <mailto:x3d-public at web3d.org>
>     <mailto:x3d-public at web3d.org <mailto:x3d-public at web3d.org>>
>     > http://web3d.org/mailman/listinfo/x3d-public_web3d.org
>     <http://web3d.org/mailman/listinfo/x3d-public_web3d.org>
>     >     <http://web3d.org/mailman/listinfo/x3d-public_web3d.org
>     <http://web3d.org/mailman/listinfo/x3d-public_web3d.org>>
>     >
>     >
>     >     ------------------------------
>     >
>     >     End of x3d-public Digest, Vol 102, Issue 25
>     >     *******************************************
>     >
>     >
>     >
>     >
>     > --
>     > Andreas Plesch
>     > Waltham, MA 02453
>     >
>     >
>     > _______________________________________________
>     > x3d-public mailing list
>     > x3d-public at web3d.org <mailto:x3d-public at web3d.org>
>     > http://web3d.org/mailman/listinfo/x3d-public_web3d.org
>     <http://web3d.org/mailman/listinfo/x3d-public_web3d.org>
>
>
>     --
>     *Leonard Daly*
>     3D Systems & Cloud Consultant
>     LA ACM SIGGRAPH Chair
>     President, Daly Realism - /Creating the Future/
>     -------------- next part --------------
>     An HTML attachment was scrubbed...
>     URL:
>     <http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20170910/93d28126/attachment-0001.html
>     <http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20170910/93d28126/attachment-0001.html>>
>
>     ------------------------------
>
>     Subject: Digest Footer
>
>     _______________________________________________
>     x3d-public mailing list
>     x3d-public at web3d.org <mailto:x3d-public at web3d.org>
>     http://web3d.org/mailman/listinfo/x3d-public_web3d.org
>     <http://web3d.org/mailman/listinfo/x3d-public_web3d.org>
>
>
>     ------------------------------
>
>     End of x3d-public Digest, Vol 102, Issue 33
>     *******************************************
>
>
>
>
> _______________________________________________
> x3d-public mailing list
> x3d-public at web3d.org
> http://web3d.org/mailman/listinfo/x3d-public_web3d.org


-- 
*Leonard Daly*
3D Systems & Cloud Consultant
LA ACM SIGGRAPH Chair
President, Daly Realism - /Creating the Future/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20170913/c0384bbd/attachment-0001.html>


More information about the x3d-public mailing list