K.1 General

This annex defines the mapping of concepts of the Programmable shaders component to the nVidia Cg shading language (see [Cg]). It applies to the ProgramShader, ShaderProgram and PackagedShader nodes with the language field set to "Cg".

K.2 Topics

Table K.1 provides links to the major topics in this annex.

K.3 Concepts

K.3.1 Rendering API support differences

The Cg language is a diverse set of shading capabilities that aim to support programmable shaders for a variety of APIs. This part of ISO/IEC 19775 supports the OpenGL and Microsoft Direct3D APIs. Programming APIs may express the same concepts in very distinctly different ways and the two cited APIs do so. Thus, a Cg shader program written to work on OpenGL will not work on Direct3D. Conversely, a Cg shader program written to work on Direct3D will not work on OpenGL.

Cg handles the incompatible code problem by defining Cg profiles. A Cg profile is a set of available shading language functionality. At the time the browser downloads the file, it can use the profile information to guide how to compile the code to the appropriate target. This annex defines its behaviour based on the Cg profile specified by the user.

K.3.2 Language strings

Cg profile information is encoded as part of the language string of the ProgramShader node. All strings starting with "CG-" define behaviour defined in this annex. The part after the prefix defines the programming API and profile for which the Cg code shall be compiled. A browser thus may quickly distinguish which nodes to ignore and which to investigate further. The source files are referenced in the ShaderProgram nodes. This specification requires that the same profile is used for both the vertex and fragment programs.

Table K.2 defines the mappings between the language string and the appropriate Cg profile. As Cg evolves, newer profiles may be defined and shall follow a similar naming convention.

K.4 Interaction with other nodes and components

K.4.1 Vertex shader

K.4.1.1 OpenGL profiles

The vertex shader replaces the fixed functionality of the vertex processor. The OpenGL specification states that the following functionality is disabled if a vertex shader is supplied:

1. The model view matrix is not applied to vertex coordinates.
2. The projection matrix is not applied to vertex coordinates.
3. The texture matrices are not applied to texture coordinates.
4. The normals are not transformed to eye coordinates.
5. The normals are not rescaled or normalized.
6. Texture coordinates are not generated automatically.
7. Per-vertex lighting is not performed.
8. Color material lighting is not performed.
9. Point size distance attenuation is not performed.

K.4.1.2 Direct3D profiles

In Cg language Direct3D profiles, the vertex shader replaces the vertex processing done by the Microsoft Direct3D graphics pipeline. While using a vertex shader, state information regarding transformation and lighting operations is ignored by the fixed-function pipeline. The Direct3D specification states that the following functionality is disabled if a vertex shader is supplied:

1. The model view matrix is not applied to vertex coordinates.
2. The projection matrix is not applied to vertex coordinates.
3. The texture matrices are not applied to texture coordinates.
4. The normals are not transformed to eye coordinates.
5. The normals are not rescaled or normalized.
6. Texture coordinates are not generated automatically.
7. Per-vertex lighting is not performed.
8. Color material lighting is not performed.
9. Point size distance attenuation is not performed.

K.4.2 Fragment shader

K.4.2.1 OpenGL profiles

The fragment shader replaces the fixed functionality of the fragment processor. The OpenGL specification states that the following functionality is disabled if a fragment shader is supplied:

1. Textures are not applied.
2. Fog is not applied.

K.4.2.2 Direct3D profiles

In Cg language Direct3D profiles, the fragment shader, also known as a pixel shader in Cg, replaces the fixed functionality of the Direct3D fragment processor. The Direct3D specification states that textures are not applied if a fragment shader is supplied.

K.4.3 LoadSensor

The LoadSensor node (See 9.4.3 LoadSensor) has two output fields isActive and isLoaded. The isLoaded field behaviour is unchanged.

The isActive field is defined to issue a TRUE event when all the following conditions have been satisfied:

1. The content identified by the url field has been successfully loaded.
2. The shader program has been successfully compiled without error.

K.4.4 Vertex attributes

K.4.4.1 OpenGL profiles

Each vertex attribute node directly maps the name field to the uniform variable of the same name. If the name is not available as a uniform variable in the provided shader source, the values of the node shall be ignored.

The browser implementation shall automatically assign appropriate internal index values for each attribute

K.4.4.2 Direct3D profiles

In Cg language Direct3D profiles, each vertex attribute node directly maps the name field to a Direct3D usage type for use within a Direct3D vertex declaration (with the prefix "D3DDECLUSAGE_" prepended to the name), as well as a Cg binding semantic of the same name defined on the varying inputs to a shader program. This language binding allows the use of the predefined Direct3D vertex declaration usage types and Cg binding semantics listed in Table K.3. If the name cannot be interpreted as a valid Direct3D usage type or Cg binding semantic, the values of the node shall be ignored.

The browser implementation shall automatically assign appropriate internal index values for each attribute in the case where multiple nodes are defined having the same value in the name field.

K.5 Data Type and Parameter Mappings

K.5.1 Node fields

Fields that are of type SFNode/MFNode are ignored unless the value is of type X3DTextureNode, or in Direct3D profiles, X3DMaterialNode, or X3DLightNode. Field instances of type X3DTextureNode are mapped according to the appropriate Direct3D or OpenGL sampler data type. The mappings from texture nodes to built-in sampler types are defined in Table K.4.

X3D does not define mappings to the OpenGL types sampler1D, sampler1DShadow and sampler2DShadow or the Direct3D types sampler1D, sampler1DShadow and sampler2DShadow.

In Cg language OpenGL profiles, the current geometry and pipeline state is exposed through the built-in variable glstate.

In Cg language Direct3D profiles, field instances of type X3DMaterialNode and X3DLightNode are mapped to structures that shall be declared in the shader program as defined in Table K.5.

struct X3DMaterial {
    float4 diffuseColor;
    float4 ambientColor;
    float4 specularColor;
    float4 emissiveColor;
    float power;
};

struct X3DLight {
    int type;
    float4 diffuseColor;
    float4 specularColor;
    float4 ambientColor;
    point3 position;
    point3 direction;
    float range;
    float falloff;
    float attenuation0;
    float attenuation1;
    float attenuation2;
    float theta;
    float phi;
    bool on;
};

K.5.2 X3D field types to Cg data types

Table K.6 indicates how the X3D field types shall be mapped to data types used in the Cg Language.

Cg defines maximum supported lengths of each array data type, which may conflict with the minimum support requirements for X3D.

K.5.3 X3D world state to Cg parameter names

In Cg language Direct3D profiles, certain internal states of the X3D world, such as transformation matrices, or the viewer's position in world space, are neither readily available via the Cg shader program or directly accessible from the X3D scene graph. Thus if used, these world state values shall be explicitly passed in to the shader program as named parameters. This binding defines an automatic mapping of these states to predefined shader program parameter names. Table K.7 specifies the mapping of internal states of the X3D world to parameter names used in the Cg programs.

The following suffixes can be applied to the matrix built-in values. A suffix of I signifies the inverse of the matrix. T signifies the transpose of the matrix. IT signifies the inverse transpose of the matrix.

K.6 Event model

K.6.1 Changing URL fields

When the url receives an event changing the value, the browser shall immediately attempt to download the new source. Upon successful download, the browser shall attempt to compile the new source and issue the appropriate LoadSensor events. It shall not automatically activate the shader program, nor disable the currently running shader.

Values defined at load time of the file do not require an explicit request to activate the shader program. It shall be assumed to automatically activate the program once all the objects have successfully downloaded. If some of the shader source files are not downloaded or compiled (e.g., due to errors), no activation shall occur for the shader program.

K.6.2 Changing the attrib field

Per-vertex attributes may be defined as one of the fields of X3DComposedGeometryNode. These may be changed at runtime by adding or removing node instances. Adding new node instances to the field shall require that the user request an explicit activate in order to make them visible to the shader.

K.6.3 Activating programs

The user may, at any time, request that the browser activate the composing shader objects by sending a TRUE value to the activate inputOnly field of the ProgramShader or PackagedShader node. Users may need to force a re-activation of the node under various circumstances, such as changing the url field of one or more ShaderProgram or PackagedShader nodes, or adding or removing ShaderProgram nodes from the programsfield of the ProgramShader node. Reactivating the shader shall replace the existing shader with the new compiled shader for subsequent rendering.