<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <div class="moz-cite-prefix">Andreas,<br>
      <br>
      Is it like drawing a line from the near to far clipping planes
      where each point on the line projects to the current cursor
      position, then taking the closest HTML element that intersects the
      line?<br>
      <br>
      I suppose you could do the inverse of that operation by projecting
      each HTML element (or container) onto the near clipping plan and
      picking the one that is the closest to the near clipping plane and
      is "under" the cursor. <br>
      <br>
      In VR with two hand controllers, you could use a line intersection
      for picking. That would be much easier.<br>
      <br>
      Leonard Daly<br>
      <br>
      <br>
      <br>
      <br>
    </div>
    <blockquote type="cite"
cite="mid:CAKdk67t2gt5gBRzW2=0OGQ0qK+Wnv5yU8yQmdy5ydM6_EQLs=w@mail.gmail.com">
      <div dir="auto">
        <div dir="auto">Leonard,</div>
        <div dir="auto"><br>
        </div>
        <div dir="auto">just as an additional pointer, there have been
          attempts in aframe to have an interactive HTML view in 3d. I
          believe they were based on backprojecting mouse events from
          the 3d plane to the page. There is perhaps an aframe component
          which does this.</div>
        <div dir="auto"><br>
        </div>
        <div dir="auto">Andreas</div>
        <div dir="auto"><br>
        </div>
        <div dir="auto"><br>
        </div>
        <div dir="auto">
          <div class="gmail_extra">
            <div class="gmail_quote">
              <blockquote class="m_-8228289799387728157quote"
                style="margin:0 0 0 .8ex;border-left:1px #ccc
                solid;padding-left:1ex"><br>
              </blockquote>
              <blockquote class="m_-8228289799387728157quote"
                style="margin:0 0 0 .8ex;border-left:1px #ccc
                solid;padding-left:1ex">
                From: Leonard Daly <<a
                  href="mailto:Leonard.Daly@realism.com" target="_blank"
                  moz-do-not-send="true">Leonard.Daly@realism.com</a>><br>
                To: <a href="mailto:x3d-public@web3d.org"
                  target="_blank" moz-do-not-send="true">x3d-public@web3d.org</a><br>
                Subject: Re: [x3d-public] Labels in 3D<br>
                Message-ID: <<a
                  href="mailto:1fd785ed-e3bb-9076-0914-ded1578d89b1@realism.com"
                  target="_blank" moz-do-not-send="true">1fd785ed-e3bb-9076-0914-ded15<wbr>78d89b1@realism.com</a>><br>
                Content-Type: text/plain; charset="utf-8";
                Format="flowed"<br>
                <br>
                Andreas,<br>
                <br>
                I had considered some of your features. I was working
                with the<br>
                requirement that the label needed to have full HTML
                support so it could<br>
                be modified, have control features (buttons, links,
                etc.) and perhaps<br>
                have other media embedded in it. I suppose it might have
                been possible<br>
                to put all of those features into a billboard-presented
                3D-space label;<br>
                but there was too much capability that would have needed
                to be recreated.<br>
                <br>
                I will keep the links as I have encountered needed to
                work from HTML to<br>
                3D texture in the past.<br>
                <br>
                Leonard Daly<br>
                <br>
                <br>
                > If the labels should live in the 3d space of the
                scene as bill boards,<br>
                > another approach would be to render the html to a
                texture using these<br>
                > approaches:<br>
                ><br>
                > <a
href="https://developer.mozilla.org/en-US/docs/Web/API/Canvas_API/Drawing_DOM_objects_into_a_canvas"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">https://developer.mozilla.org/<wbr>en-US/docs/Web/API/Canvas_API/<wbr>Drawing_DOM_objects_into_a_can<wbr>vas</a><br>
                > <a
                  href="https://html2canvas.hertzen.com/documentation.html"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">https://html2canvas.hertzen.co<wbr>m/documentation.html</a><br>
                ><br>
                > x3dom can then use the canvas element directly as a
                texture for a<br>
                > rectangle plane bill boarded next to the object to
                be labelled.<br>
                ><br>
                > The leader line in this case is simply a 3d line or
                tube from the<br>
                > object to the label rectangle.<br>
                ><br>
                > Ideas, Andreas<br>
                ><br>
                >     Date: Tue, 5 Sep 2017 11:51:11 -0700<br>
                >     From: Leonard Daly <<a
                  href="mailto:Leonard.Daly@realism.com" target="_blank"
                  moz-do-not-send="true">Leonard.Daly@realism.com</a><br>
                >     <mailto:<a
                  href="mailto:Leonard.Daly@realism.com" target="_blank"
                  moz-do-not-send="true">Leonard.Daly@realism.<wbr>com</a>>><br>
                >     To: X3D Public <<a
                  href="mailto:x3d-public@web3d.org" target="_blank"
                  moz-do-not-send="true">x3d-public@web3d.org</a>
                <mailto:<a href="mailto:x3d-public@web3d.org"
                  target="_blank" moz-do-not-send="true">x3d-public@web3d.org</a>>><br>
                >     Subject: [x3d-public] Labels in 3D<br>
                >     Message-ID: <<a
                  href="mailto:9965f0da-0842-772f-a3b1-131af3f167b0@realism.com"
                  target="_blank" moz-do-not-send="true">9965f0da-0842-772f-a3b1-131af<wbr>3f167b0@realism.com</a><br>
                >     <mailto:<a
                  href="mailto:9965f0da-0842-772f-a3b1-131af3f167b0@realism.com"
                  target="_blank" moz-do-not-send="true">9965f0da-0842-772f-a3<wbr>b1-131af3f167b0@realism.com</a>>><br>
                >     Content-Type: text/plain; charset="utf-8";
                Format="flowed"<br>
                ><br>
                >     This is mostly for Nicholas and Vince who
                expressed an interest in<br>
                >     labeling things in 3D where the labels had the
                capability of HTML to<br>
                >     include various fonts, styles, text, graphics,
                links, etc.<br>
                ><br>
                >     I would like to know if these types of labels
                meet your needs or<br>
                >     something else is needed.<br>
                ><br>
                >     This is using my testbed (XSeen). The example
                is at<br>
                >     <a
                  href="http://realism.com/XSEEN/test/labels.html"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://realism.com/XSEEN/<wbr>test/labels.html</a><br>
                >     <<a
                  href="http://realism.com/XSEEN/test/labels.html"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://realism.com/XSEEN/tes<wbr>t/labels.html</a>>.<br>
                ><br>
                >     All labels are done in HTML. The lines
                connecting the label to the 3D<br>
                >     object is done in 3D space. The labels retain
                their screen position as<br>
                >     the camera is moved. There are three types of
                labels illustrated<br>
                >     in the<br>
                >     example -- fixed, relative, and draggable.<br>
                ><br>
                >     The fixed label is attached to the "monster"
                The label line tracks the<br>
                >     local origin of the monster model.<br>
                ><br>
                >     The relative label maintains the initial
                relative screen position<br>
                >     to the<br>
                >     projection of the (local) origin of the object.
                The label moves as the<br>
                >     object moves. This is particularly obvious when
                looking from the side.<br>
                ><br>
                >     The last label (draggable) is attached to the
                torus. The user may move<br>
                >     the label to any position in the canvas (2D
                projection of the 3D<br>
                >     space).<br>
                >     The leader line maintains the connection from
                the label to the object.<br>
                ><br>
                >     There is preliminary documentation on the tag
                at<br>
                >     <a
href="http://tools.realism.com/specification/xseen/language-definition/user-interactions/label"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://tools.realism.com/spec<wbr>ification/xseen/language-defin<wbr>ition/user-interactions/label</a><br>
                >     <<a
href="http://tools.realism.com/specification/xseen/language-definition/user-interactions/label"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://tools.realism.com/spe<wbr>cification/xseen/language-defi<wbr>nition/user-interactions/label</a><wbr>><br>
                ><br>
                >     Caveats:<br>
                >     1) The leader lines do not track well when the
                camera position is<br>
                >     changing nor when a draggable label is being
                moved.<br>
                >     2) Things don't work as you would expect (or
                hope) for the stereo<br>
                >     camera.<br>
                ><br>
                ><br>
                >     --<br>
                >     *Leonard Daly*<br>
                >     3D Systems & Cloud Consultant<br>
                >     LA ACM SIGGRAPH Chair<br>
                >     President, Daly Realism - /Creating the Future/<br>
                >     -------------- next part --------------<br>
                >     An HTML attachment was scrubbed...<br>
                >     URL:<br>
                >     <<a
href="http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20170905/01d20b36/attachment.html"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://web3d.org/pipermail/x<wbr>3d-public_web3d.org/attachment<wbr>s/20170905/01d20b36/attachment<wbr>.html</a><br>
                >     <<a
href="http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20170905/01d20b36/attachment.html"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://web3d.org/pipermail/x<wbr>3d-public_web3d.org/attachment<wbr>s/20170905/01d20b36/attachment<wbr>.html</a>>><br>
                ><br>
                >     -----------------------------<wbr>-<br>
                ><br>
                >     Subject: Digest Footer<br>
                ><br>
                >     _____________________________<wbr>__________________<br>
                >     x3d-public mailing list<br>
                >     <a href="mailto:x3d-public@web3d.org"
                  target="_blank" moz-do-not-send="true">x3d-public@web3d.org</a>
                <mailto:<a href="mailto:x3d-public@web3d.org"
                  target="_blank" moz-do-not-send="true">x3d-public@web3d.org</a>><br>
                >     <a
                  href="http://web3d.org/mailman/listinfo/x3d-public_web3d.org"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://web3d.org/mailman/list<wbr>info/x3d-public_web3d.org</a><br>
                >     <<a
                  href="http://web3d.org/mailman/listinfo/x3d-public_web3d.org"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://web3d.org/mailman/lis<wbr>tinfo/x3d-public_web3d.org</a>><br>
                ><br>
                ><br>
                >     -----------------------------<wbr>-<br>
                ><br>
                >     End of x3d-public Digest, Vol 102, Issue 25<br>
                >     *****************************<wbr>**************<br>
                ><br>
                ><br>
                ><br>
                ><br>
                > --<br>
                > Andreas Plesch<br>
                > Waltham, MA 02453<br>
                ><br>
                ><br>
                > ______________________________<wbr>_________________<br>
                > x3d-public mailing list<br>
                > <a href="mailto:x3d-public@web3d.org"
                  target="_blank" moz-do-not-send="true">x3d-public@web3d.org</a><br>
                > <a
                  href="http://web3d.org/mailman/listinfo/x3d-public_web3d.org"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://web3d.org/mailman/listi<wbr>nfo/x3d-public_web3d.org</a><br>
                <br>
                <br>
                --<br>
                *Leonard Daly*<br>
                3D Systems & Cloud Consultant<br>
                LA ACM SIGGRAPH Chair<br>
                President, Daly Realism - /Creating the Future/<br>
                -------------- next part --------------<br>
                An HTML attachment was scrubbed...<br>
                URL: <<a
href="http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20170910/93d28126/attachment-0001.html"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://web3d.org/pipermail/x3<wbr>d-public_web3d.org/attachments<wbr>/20170910/93d28126/attachment-<wbr>0001.html</a>><br>
                <br>
                ------------------------------<br>
                <br>
                Subject: Digest Footer<br>
                <br>
                ______________________________<wbr>_________________<br>
                x3d-public mailing list<br>
                <a href="mailto:x3d-public@web3d.org" target="_blank"
                  moz-do-not-send="true">x3d-public@web3d.org</a><br>
                <a
                  href="http://web3d.org/mailman/listinfo/x3d-public_web3d.org"
                  rel="noreferrer" target="_blank"
                  moz-do-not-send="true">http://web3d.org/mailman/listi<wbr>nfo/x3d-public_web3d.org</a><br>
                <br>
                <br>
                ------------------------------<br>
                <br>
                End of x3d-public Digest, Vol 102, Issue 33<br>
                ******************************<wbr>*************<br>
              </blockquote>
            </div>
            <br>
          </div>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
x3d-public mailing list
<a class="moz-txt-link-abbreviated" href="mailto:x3d-public@web3d.org">x3d-public@web3d.org</a>
<a class="moz-txt-link-freetext" href="http://web3d.org/mailman/listinfo/x3d-public_web3d.org">http://web3d.org/mailman/listinfo/x3d-public_web3d.org</a>
</pre>
    </blockquote>
    <p><br>
    </p>
    <div class="moz-signature">-- <br>
      <font class="tahoma,arial,helvetica san serif" color="#333366">
        <font size="+1"><b>Leonard Daly</b></font><br>
        3D Systems & Cloud Consultant<br>
        LA ACM SIGGRAPH Chair<br>
        President, Daly Realism - <i>Creating the Future</i>
      </font></div>
  </body>
</html>