[x3d-public] [Remaining Work] X3dToPython.xslt, BooleanSequencer keyValue

Tue Jul 5 09:41:26 PDT 2022

I don't know what normalize-space does right now, but I trust you!  Your
results look good, Thanks!

I may follow-with testing later.  I'd like to include a JSON patch based on
your patch.

John

On Tue, Jul 5, 2022 at 11:28 AM Brutzman, Donald (Don) (CIV) <
brutzman at nps.edu> wrote:

> [Summary: X3D to Python MFBool conversion problem fixed.]
>
>
>
>    1. Thanks for diagnosis and focus on correct code block.  The actual
>    conversion problem was failure to normalize whitespace (including original
>    commas) before changing blank characters to comma separators in final
>    output.  Thus multiple blank and comma characters (which together are
>    allowed whitespace in the XML output) were previously getting converted to
>    multiple commas, ouch.
>
>
>
> Revised XSLT:
>
>    - <xsl:variable name="commaSeparatedMFBool"
>    select="translate(normalize-space(translate(translate(translate(string($x3dValue),'f','F'),'t','T'),',','
>    ')),' ',',')"/>
>
>
>
> I modified a test scene and checked the converted output:
>
>    -
>    https://www.web3d.org/x3d/content/examples/Basic/development/BooleanSequencerExample.x3d
>    -
>    https://www.web3d.org/x3d/content/examples/Basic/development/BooleanSequencerExample.py
>
>
> Revised model excerpts and correct output with diagnostic turned on:
>
>
>
>    - <BooleanSequencer DEF='LeftViewBinder' key='0 0.1 0.25'
>    keyValue='false true false'/>
>    - <BooleanSequencer DEF='BackViewBinder' key='0 0.375 0.475'
>    keyValue='false, true, false'/>
>    - <BooleanSequencer DEF='RightViewBinder' key='0 0.5 0.6'
>    keyValue='false , true , false'/>
>
>
>
> create python:
>
> C:\x3d-code\www.web3d.org\x3d\content\examples\Basic/development//BooleanSequencerExample.x3d
> processing with X3dToPython stylesheet...
>
> *** MFBool handling, $x3dValue='false true false,
> $commaSeparatedMFBool='False,True,False
>
> *** MFBool handling, $x3dValue='false, true, false,
> $commaSeparatedMFBool='False,True,False
>
> *** MFBool handling, $x3dValue='false , true , false,
> $commaSeparatedMFBool='False,True,False
>
>
>
>    -
>    BooleanSequencer(DEF='LeftViewBinder',key=[0,0.1,0.25],keyValue=[False,True,False]),
>    -
>    BooleanSequencer(DEF='BackViewBinder',key=[0,0.375,0.475],keyValue=[False,True,False]),
>    -
>    BooleanSequencer(DEF='RightViewBinder',key=[0,0.5,0.6],keyValue=[False,True,False]),
>
>
>
> Original test scene goes back to original state, since X3D
> Canonicalization (C14N) changes those pesky commas back into single blank
> characters.
>
>
>
>    - ISO/IEC 19776-3, Extensible 3D (X3D) encodings, Part 3: Compressed
>    binary encoding
>    - Annex 4 Concepts, Clause 4.2.3 X3D canonical form
>    -
>    https://www.web3d.org/documents/specifications/19776-3/V3.3/Part03/concepts.html#X3DCanonicalForm
>
>
>
>    - X3D Canonicalizer
>    -
>    https://svn.code.sf.net/p/x3d/code/www.web3d.org/x3d/tools/canonical/doc/x3dTools.htm
>
>
>
> X3dToPython.xslt stylesheet committed, changes should be good for you now.
>
>
>
>    1. Regarding rephrased tooltip for MFBool: please note
>
>
>    1. All such hints are similarly / identically phrased for
>    maintainability,
>    2. All tooltip hints are for XML encoding, too easily confused
>    otherwise.
>
>
>
>    - X3D4 Tooltips, FieldTypesTable
>    - https://www.web3d.org/x3d/tooltips/X3dTooltips.html#FieldTypesTable
>    - For MFBool:
>
> *Hint:* comma characters are allowed as whitespace between individual
> SFBool values in the list.
> *Hint:* comma characters are not included in canonical form.
>
>
>
> So I think we are good.  Again thanks for a helpful catch.
>
>
>
> all the best, Don
>
> --
>
> Don Brutzman  Naval Postgraduate School, Code USW/Br
> brutzman at nps.edu
>
> Watkins 270,  MOVES Institute, Monterey CA 93943-5000 USA
> +1.831.656.2149
>
> X3D graphics, virtual worlds, Navy robotics https://
> faculty.nps.edu/brutzman
>
>
>
> *From:* John Carlson <yottzumm at gmail.com>
> *Sent:* Monday, July 4, 2022 7:25 PM
> *To:* Brutzman, Donald (Don) (CIV) <brutzman at nps.edu>; X3D Graphics
> public mailing list <x3d-public at web3d.org>; holger.seelig at gmail.com
> *Subject:* Re: [Remaining Work] X3dToPython.xslt, BooleanSequencer
> keyValue
>
>
>
> Code in question in X3dToPython.xslt, I think, for MFBool's.
>
>
>
>             <xsl:when test="($x3dType = 'MFBool')">
>                 <!-- Python boolean values are True and False,
> comma-separated list -->
>                 <xsl:value-of
> select="translate(translate(translate(string($x3dValue),'f','F'),'t','T'),'
> ',',')"/>
>             </xsl:when>
>
>
>
> Spaces are translated to ',', i think, to "true, false" in XML gets
> translated to "True,,False" in Python.
>
>
>
> I don't know how to fix this yet (I'm an XSLT plebe), except fix the XML
> so Python will work okay.  Maybe we should put a feature request into Saxon
> or ask for help?
>
>
>
> At this point, my suggestion would be to fall back to some kind of regular
> expression replacement?
>
>
>
> Or what I would do in sed, like:
>
>
>
> s/,+/,/g
>
>
>
> and
>
>
>
> s/ +/ /g
>
>
>
> between SFBools
>
>
>
> One may wish to put \s or \S , from more advanced regular expressions, and
> only allow one comma between SFBools in the MFBool.
>
>
>
> I don't know if XSLT supports any of this.  Check out this table for XSLT
> 2.0?  Is this accurate?
>
>
>
> 16.4 Using Regular Expressions | Learning XSLT (flylib.com)
> <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fflylib.com%2Fbooks%2Fen%2F2.424.1.122%2F1%2F&data=05%7C01%7Cbrutzman%40nps.edu%7Cfebd8a7a066b4c06d29108da5e2d9806%7C6d936231a51740ea9199f7578963378e%7C0%7C0%7C637925847160880998%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=AfjPGqSrV4%2BwpPzxROzihR3yWwKSRezo89pEJWCXU3g%3D&reserved=0>
>
>
>
> Did a little googling, found this:
>
>
>
> regex - XSLT + regular expression replace - Stack Overflow
> <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstackoverflow.com%2Fquestions%2F35840063%2Fxslt-regular-expression-replace&data=05%7C01%7Cbrutzman%40nps.edu%7Cfebd8a7a066b4c06d29108da5e2d9806%7C6d936231a51740ea9199f7578963378e%7C0%7C0%7C637925847160880998%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=YogJt1t6CIIgoer9GrMVA7rfWfN7RGU7wieOdYT714Y%3D&reserved=0>
>  (analyze-string)
>
>
>
> Perhaps a few of us could attend an advanced XSLT course?
>
>
>
> Maybe we could have a learning session?  I only see one analyze-string in
> our XSLT code base.
>
>
>
> Could be a big win, would be my guess.
>
>
>
> Or we could use SNOBOL or its derivative, Icon. Icon (programming
> language) - Wikipedia
> <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fen.wikipedia.org%2Fwiki%2FIcon_%2528programming_language%2529&data=05%7C01%7Cbrutzman%40nps.edu%7Cfebd8a7a066b4c06d29108da5e2d9806%7C6d936231a51740ea9199f7578963378e%7C0%7C0%7C637925847160880998%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=QzM1Glrkto0CBwqHC6wZ6zx6ecYDM7vzLFvavlL7u%2BA%3D&reserved=0> (see
> "Dialects" and "Influenced" for additional features, some 3D).
>
>
> I studied Icon in school, and it was a good language, I didn't run into
> any snafu's with our problem set solutions.
>
>
>
> I would recommend Icon over XML, XSLT, Python and JavaScript, if anyone
> cares, at least for text processing.  I didn't do 3D with Icon.
>
>
>
> John
>
>
>
> On Mon, Jul 4, 2022 at 8:18 PM John Carlson <yottzumm at gmail.com> wrote:
>
> Trying to help...For MFBool in X3d tooltips, perhaps rephrase whitespace
> as below, for both XML, JSON and Python (and perhaps others).
>
>
>
> *Hint:* a single comma character is allowed as whitespace between
> individual SFBool values in the list.
>
>
>
> Sorry, I apologize for bringing up MFStrings.  I was in the wrong.
>
>
>
>
>
>
>
> On Mon, Jul 4, 2022 at 7:53 PM John Carlson <yottzumm at gmail.com> wrote:
>
> If commas are not allowed in XML for MFBool, then Holger needs to change
> her particle system code.
>
>
>
>
>
> On Mon, Jul 4, 2022 at 7:49 PM John Carlson <yottzumm at gmail.com> wrote:
>
> Note: Please clarify MFBool. I will look again at recent emails.
>
>
>
> My understanding is that SFBool values can be separated by /, / comma
> followed by space in an MFBool in XML (comma as whitespace). What I'm not
> understanding is the Python output from X3dToPython.xslt, which puts out
> commas next to each other (comma not as whitespace).  See below.
>
>
>
> On Mon, Jul 4, 2022 at 4:56 PM John Carlson <yottzumm at gmail.com> wrote:
>
> Note extra commas in MFBool outputs from X3dToPython.xslt and
> X3dToJson.xslt.
>
>
>
> On Mon, Jul 4, 2022 at 4:23 PM John Carlson <yottzumm at gmail.com> wrote:
>
> Note, the following examples are unvalidated. Beware!
>
>
>
> For example, from:
> https://raw.githubusercontent.com/create3000/Library/main/Tests/Components/ParticleSystems/BoundedPhysicsModel.x3d
> <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fraw.githubusercontent.com%2Fcreate3000%2FLibrary%2Fmain%2FTests%2FComponents%2FParticleSystems%2FBoundedPhysicsModel.x3d&data=05%7C01%7Cbrutzman%40nps.edu%7Cfebd8a7a066b4c06d29108da5e2d9806%7C6d936231a51740ea9199f7578963378e%7C0%7C0%7C637925847160880998%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=YNS4TaXeAD7d0Cznh6VzX5gD81gEsGo6g7rGkaFV90g%3D&reserved=0>
>
>     <BooleanSequencer DEF='_4'
>         key='0, 0.3, 1'
>         keyValue='true, false'/>
>
>
>
> And python:
>
>
>
> BooleanSequencer(DEF='_4',key=[0,0.3,1],keyValue=[True,,False]),
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://web3d.org/pipermail/x3d-public_web3d.org/attachments/20220705/575be974/attachment-0001.html>