= Project Writeup : Sakura ("Cherry Blossom") = = Team = * Tom Wang * Priscilla Pham = Inspiration Images = || attachment:2sakura-macro.JPG.jpg || || attachment:pic.png || attachment:120875974_520ed3efcd.jpg || = Overview = Sakura trees (also known as cherry blossom trees) are among the most beautiful trees in nature and also present a worthwhile rendering challenge. In addition, we will procedurally model blossom petals by using an adaptation of the rose curve. Finally, we intend to employ subsurface scattering on the petals to capture the realistic details of softness and faint translucency. = Tree Overview = I model the tree procedurally with a modified L-system (defined with probability distribution functions along each depth of recursion) using generalized cylinders. I then generate a per-cylinder displacement map based on the geometry of the cylinder to add natural bark perturbation, enhancing realism. Next, I overlay with a per-cylinder bump map to emulate the circular indents present in lentical bark. Finally, I texture map a cherry blossom bark onto each cylinder. I provide technical details of each component below. = Procedural Tree Generation - Tom = == Source Code == attachment:code.cpp == L-system Background == An L-system is a parallel string rewriting system, in which a simulation begins with an initial string called the axiom, which consists of modules, or symbols with associated numerical parameters. In each step of the simulation, rewriting rules—or productions—replace all modules in the predecessor string by successor modules. The resulting string can be visualized as a series of commands that link nodes, represent rotations, and distances between nodes. == Probability Distribution Function Implementation == I model each part of the tree as generalized cylinders and control the look of the tree with the following parameters: * Bottom radius * Top radius * Height * 3D Rotation and Translation * Initial radius fade (how much smaller the start radius of a sub-branch is) * Final radius fade (how much smaller the end radius of a sub-branch is) * Gnarling (overall displacement for next cylinder in link) * Number of sub-branches * Location of sub-branches Each cylinder is composed of a mesh of vertices in triangle strip format - these vertices are oriented as 'slices' (subdivisions around the main axis of the cylinder) and 'stacks' (subdivisions along the main axis of the cylinder). I am using a heavily modified gluCylinder() approach. Parameters are defined to be within certain ranges, depending on the level of branching, and are chosen with a uniform probability distribution function. For example, the trunk defines: === Trunk === * Trunk radius - [1.7, 2.0] * Trunk height - [4, 5] * Trunk radius * Initial Fade - [1, 1] * Final Fade - [.8, .9] * Branches - [2] * Location of branches - [Trunk height] === Branch === * 1st Level Branch radius - Trunk's Top Radius * 1st Level Branch height - [4, 12] * radius * 1st Level Branch initial fade - 1 * 1st Level Branch final fade - [.3, .8] (varies linearly to branch height) * Branches - [2, 3] * Location of branches - [.95 * branch height, branch height] === Sub-branch === * Sub Branch radius - Previous branch top radius * initial fade * Sub Branch height - [6, 12] * radius * Sub Branch initial fade - 1 (for level <= 3), [.8, .9] (otherwise) * Sub Branch final fade - [.1, .6] (for level <= 3), [.1, .35] (for level 4), [.3, .5] (otherwise) * Branches - [2, 2], [3, 4], [2, 6], [1, 4] (for levels 3, 4, (5, 6), and 7) * Location of branches - [.5, .95] In order to generate the tree, I begin with the trunk and continue branching until I either reach a cutoff level (level == 7) or the branches become too small (radius < .01). This technique is implemented as described in Oppenheimer's paper [10]. A few more details involved adding discs to either end of the cylinder to make them closed cylinders, creating a probability distribution for arbitrary rotations in 3D space, sectioning 3D space so that each branch gets its own portion to try to prevent against branch intersection (a true intersection test would be nice, but too expensive), modeling the vertical inclination of trees as described in Weber's paper [11], and calculating PDF parameters to ensure the tree stays within a desired bounds (also mentioned in [11]). The images below demonstrate my tweaking of PDF parameters to match the desired ratios for realistic cherry blossom trees. === Basic Texture, No Branching === attachment:tree1.png === Basic Branching, Lighting === attachment:tree2.png === Model Leaves, Perspective === attachment:tree3.png === True Branching, Cherry Tree Properties === attachment:tree4.png === Gnarled Rotations, Proportional Trunk === attachment:tree5.png === Smooth Gnarled, Reduce Leaf Noise === attachment:tree6.png === Increase Triangle Count, Decrease Sudden Knobs === attachment:tree7.png = Procedural Bump and Displacement Mapping - Tom = In order to better simulate the natural bumpiness of trees in reality, it became important to introduce displacement maps to change the physical geometry of vertices on the generalized cylinders as well as bump maps to change lighting normals and emphasize 'rings' of depth indicative of lentical bark. I first attempted to implement this inside a vertex shader using a texture as the source for normals and displacement and soon discovered that I needed to know the geometry related to each vertex to achieve the desired effect. Displacing too much would make small branches look weird and displacing too little would affect the trunk. Instead, I chose to solve this problem by creating procedural displacement maps per branch - these maps look like random noise ranging uniformly from [-branch_radius/4, branch_radius/4]. Also, I create procedural bump maps per branch - these maps look like different frequencies of horizontal lines, each row has a random probability of generating a line and probabilities for the offset and length of this line. When applied to the tree, the bump map looks like circular rings. I intended to also implement procedural texture mapping in the same fashion but discovered that PBRT only takes a single texture as input for triangle meshes. This means that I could not achieve a per-cylinder effect as I had done prior (I used OpenGL to modify the vertices and surface normals before I output to PBRT) unless I created an extremely large texture and had each cylinder index into a different portion of the texture. I did not have time to implement this before the rendering competition and was forced to use a static texture of a cherry tree. Below is a picture of the tree with displacement mapping. === Natural Bark Perturbation With Displacement Mapping === attachment:tree8.png = OpenGL Application for Rapid Prototyping - Tom = Since PBRT doesn't allow for camera controls in real-time without doing another rendering pass, I wanted a much quicker prototyping environment to tweak my many parameters. I opted to go with OpenGL and defined a fairly comprehensive application that allowed me to rotate, zoom, translate, change perspective, generate a new tree, and output to PBRT file at runtime. This turned out to save me a lot of time overall since small tweaks on PBRT were prohibitively slow. I ended up writing a quick file utility that would output an OpenGL triangle strip into a PBRT triangle mesh with normals, texture coordinates, and indices defined. Finally, the last work left was to tweak the image, find a good tree model, and pick a backdrop. === Ninth Render (backdrop) === attachment:render11.png === Ninth Render (different model) === attachment:render10.png = Classic Plane Curves = == Background == Prunus serrulata are dicots and possess five petals, five sepals, several stamen and a pistil. attachment:japan-sakura-017.3.jpg We observed that in this case that the beauty of nature coincides with the beauty of mathematics. More specifically, the shape and geometry of these blossoms can be recreated with curves defined in polar coordinates. == Blossom Geometry (Priscilla) == The blossom is constructed from plane curves that most closely resemble the shapes of the petals and sepals. The following is a diagram of the parts of a typical dicot: attachment:flower2a.gif The shapes of the petals resemble [http://mathworld.wolfram.com/Cardioid.html cardioids]: attachment:index_gr_16.gif ... and the placement of the petals are similar to the maxima of the 5 petal [http://mathworld.wolfram.com/Cardioid.html rose curve]: attachment:index_gr_205.gif The star shape and positioning of the sepals resemble a 5 point [http://mathworld.wolfram.com/Hypocycloid.html hypocycloid] : attachment:index_gr_133.gif This is a mathematica modeling of a single petal, with the commands used: attachment:MathcaPetal.png All petals together: attachment:MathcaAllPetals1.png and then with varied sine and cosine noise added to the z-component as well as variance in curvature, so that the petals are not completely flat and emulate the imperfection in nature: attachment:crinkcode.png attachment:MathcaCrink.png The petals are cardioids with the z-coordinate following the shape of a [http://mathworld.wolfram.com/Paraboloid.html paraboloid] to create the upcurving effect of the petals. The position of the petals around the center of the blossom are calculated according to those of the 5 petal [http://mathworld.wolfram.com/Cardioid.html rose curve]. This final version of the model took more than an hour for Mathematica to render and would sometimes abort in the middle. If the increment step were decreased, the crinkles became sharp and jagged instead of smoothly curving. The final product was well worth the wait but the rendering effort was an unexpected roadblock. The following is a Mathematica model of the sepals made of the [http://mathworld.wolfram.com/Hypocycloid.html hypocycloid] with similar parabolic upcurving, plus the stem: attachment:mcb1.png attachment:mcb2.png The pistil and stamen are relatively straightforward to generate, as they are just segments with [http://mathworld.wolfram.com/Ellipsoid.html ellipsoids] at the end. attachment:stamen.png The following is a plain PBRT rendering of the final bare model: attachment:firstMod.png Here is one of the images where I experimented with color, texture, and environment map infinite lighting. Notice also a rotated version where the sepals at the base are displayed prominently: attachment:2mod.png Here is some experimentation with "dramatic" spot lights. lt gave a poor effect, as spot lights usually give a harsh appearance: attachment:trans.png == Texture Mapping (Priscilla) == After petal generation has concluded, the plan was to generate randomized veins on the petal (all originating from the center) with a jitter transform, vertex noise, and/or Worley cellular texturing (procedural). According to one paper that this would have been based on, "The vein pattern for the petals is actinodromous venation, in which three or more primary veins diverge radially from a single point. Primary veins support sequences of secondary (lateral) veins, which may branch further into higher-order veins. The secondary veins and their descendants may be free-ending, which produces an open, tree-like venation pattern, or they may connect (anastomose), forming loops characteristic of a closed pattern. Tertiary and higher-order veins usually link the secondaries, forming a ladder-like (percurrent) or netlike (reticulate) patterngrid size in every simulation step, which precludes continuous simulation of growth. Vein segments are straight, and segments double in length in each growth step, which yields artificial-looking long straight lines running through the pattern." [7] This could possibly have been done with l-systems, although a different kind from the one used for the tree branches. Due to time constraints, however, this was not applied. = Subsurface Scattering (Priscilla) = Subsurface scattering (or SSS) is a mechanism of light transport in which light penetrates the surface of a translucent object, is scattered by interacting with the material, and exits the surface at a different point. The light will generally penetrate the surface and be reflected a number of times at irregular angles inside the material, before passing back out of the material at an angle other than the angle it would reflect at had it reflected directly off the surface. (Wikipedia) == Background == Rose petals are translucent and to achieve the realistic, silky, lifelike softness we must implement SSS. This may be achieved with the reflection model described in the paper by Hanrahan/Krueger. We will also study the structure and cellular layers of petals. So far, we have learned that two especially characteristic layers, such as upper epidermal cells which are dome-shaped and spongy cells which reflect much light, cause the unique appearance of rose petals. attachment:fig8.jpg attachment:roseCross.png [9] Petals resemble thin surfaces, and their cross-sections can be described by open contours. We hope to apply this and other plant biology knowledge to enhance the appearance of the sakura petals. == Petal SSS == I wrote a new petal material plugin to PBRT, which added the BxDF per Hanrahan and Krueger [4]. I noted that in the diagram above of the cellular layers of petals was significantly less and thinner than the leaf diagram that the paper mentioned and took this as a justification of using the first order approximation method. The radiance is computed by summing the radiance from surface and subsurface scattering, and the transmitted radiance from the sum of the radiance from absorption and subsurface scattering. From these values and the Fresnel coefficients, I calculate the BRDF and the BTDF. I used an index of refraction of 1.37 for the material, 1 for air, 3.8 for sig_a, 50 for sig_f, .15 for depth, 50 for g. For the phase function I used the Henyey-Greenstein approximation given in the paper: attachment:henyey.png Backscatter radiance: attachment:backscatter.png Forward scatter radiance: attachment:fwdscatter.png: Foward scatter ignoring singular values: attachment:foapproxeq.png For setting the initial specular and diffuse values I used a color picker in The Gimp on the model image. I added extra reflectance with microfacets to find the look that needed. What could have been done further was to look into the properties of the layers given in the Kotani[8] paper and applied the algorithm in a similar fashion to the leaf in the Hanrahan/Kreuger[4] paper. == Final Single Sakura Blossom == attachment:singleSakura.png == One Blossom Next to Tree == attachment:oneBloss.png == Final Image == attachment:firstfin.png = Links = [1] [http://www-evasion.imag.fr/Publications/2002/LN02/bark.pdf Synthetic Bark] [2] [http://portal.acm.org/citation.cfm?id=602336&coll=portal&dl=ACM&ret=1 Procedural Multiresolution for Plant and Tree Rendering] [3] [http://graphics.ucsd.edu/~henrik/images/subsurf.html Jensen's SSS site] [4] [http://portal.acm.org/citation.cfm?id=166117.166139 Hanrahan, P. and Krueger, W. 1993. Reflection from layered surfaces due to subsurface scattering. In Proceedings of the 20th Annual Conference on Computer Graphics and interactive Techniques SIGGRAPH '93. ACM Press, New York, NY, 165-174.] [5] [http://citeseer.ist.psu.edu/fowler92collisionbased.html Deborah R. Fowler, Przemyslaw Prusinkiewicz, and Johannes Battjes. A Collision-based Model of Spiral Phyllotaxis. Proceedings of SIGGRAPH '92 (Chicago, Illinois, July 26-31, 1992), In Computer Graphics, 26, 2, (July 1992), ACM SIGGRAPH, New York, pp. 361-368.] [6] [http://graphics.stanford.edu/cs348b.06/RanjithaKumar/FinalProject Final Project: Rendering Lily Pads] [7] [http://doi.acm.org/10.1145/1073204.1073251 Runions, A., Fuhrer, M., Lane, B., Federl, P., Rolland-Lagan, A., and Prusinkiewicz, P. 2005. Modeling and visualization of leaf venation patterns. ACM Trans. Graph. 24, 3 (Jul. 2005), 702-711. ] [8] [http://ieeexplore.ieee.org/iel5/6632/17691/00817184.pdf?isnumber=17691∏=STD&arnumber=817184&arnumber=817184&arSt=593&ared=596+vol.3&arAuthor=Kotani%2C+K.%3B+Tachino%2C+R.%3B+Terado%2C+I.%3B+Kenmochi%2C+Y. Kotani, K.; Tachino, R.; Terado, I.; Kenmochi, Y. Reflection and transparency model of rose petals for computer graphics based on the micro-scopic scale structures. Image Processing, 1999. ICIP 99. Proceedings. 1999 International Conference on, Vol.3, Iss., 1999. Pages:593-596 vol.3] [9] [http://www.pbrt.org/ Pharr, M. and Humphreys, G. 2004 Physically Based Rendering: from Theory to Implementation. Morgan Kaufmann Publishers Inc., 828-9.] [10][http://portal.acm.org/ft_gateway.cfm?id=15892&type=pdf&coll=GUIDE&dl=GUIDE&CFID=25486051&CFTOKEN=83394336 Peter E. Oppenheimer, Real time design and animation of fractal plants and trees, Proceedings of the 13th annual conference on Computer graphics and interactive techniques, p.55-64, August 1986] [11][http://portal.acm.org/ft_gateway.cfm?id=218427&type=pdf&coll=GUIDE&dl=GUIDE&CFID=25486147&CFTOKEN=22693849 Jason Weber , Joseph Penn, Creation and rendering of realistic trees, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.119-128, September 1995]